i%dZddlZddlZddlmZddlmZejeZ eGddZ gdZ gdZ d Z d Zd Zd ed e fdZded efdZd ed eeeffdZy)zh Content validation for generated articles. Checks word count, error patterns, and blacklisted content. N) dataclass)OptionalcTeZdZUeed<dZeeed<dZe ed<dZ e eed<dZ y)ValidationResultvalidNreasonr word_countwarningsc,|jg|_yy)N)r )selfs ;/var/www/html/content-pipeline/modules/content_validator.py __post_init__zValidationResult.__post_init__s == DM !) __name__ __module__ __qualname__bool__annotations__rrstrr intr listrrr rrs2 K FHSM JHd3irr)z (?i)as an aiz (?i)als kiz (?i)i cannotz(?i)ich kann nichtz(?i)i don't have accessz(?i)i'm unable toz(?i)i am unable toz(?i)please note that iz(?i)it's important to notez((?i)es ist wichtig zu beachten, dass ichz(?i)leider kann ichz(?i)unfortunately,? iz (?i)\[insertz(?i)\[placeholderz (?i)\[TODOz (?i)\[EXAMPLEz (?i)\[your z(?i)lorem ipsumz(?i)xxx+z(?i)tbd) z (?i)\bapcoa\bz(?i)\bcontipark\bz(?i)\bq-park\bz(?i)\bparkraum24\bz(?i)\bfairparken\bz(?i)\bfair\s+parken\bz(?i)\beasypark\bz(?i)\bpaybyphone\bz(?i)\bparkster\bz(?i)\bparknow\bz(?i)\bpark now\bz(?i)\bscheidt\s*&\s*bachmann\bz&(?i)\bpark\s*(?:&|and|und)\s*control\biicontentreturnc *g}t|}|ttz krtdd|dtd|S|ttzkDr|j d|dtdt D]}tj||stj||}|td|jd z |jd z}tdd |jd |d |cStD]}tj||}|std|jd z }tt||jd z}|||j!dd}tdd|jd|d |cStjd|tj"s|j dtjd|tj"stdd|Stjd|s|j dttj$d|tj"}|dkr|j d|d|D]} t&j)d| td||S)z Validate article content against quality requirements. Returns ValidationResult with valid=True if content passes all checks. FzWord count too low: z (minimum: ))rrr zWord count high: z (target max: rzError pattern detected: 'z' in context: '...z...'  zCompetitor mention blocked: 'z ' in '...z^#\s+zNo H1 heading foundz^##\s+z.No H2 headings found - article lacks structureu&(?i)(faq|häufig\s+gestellte\s+fragen)zNo FAQ section detectedzOnly z! H2 headings found (recommend 4+)zContent warning: T)rr r ) _count_wordsMIN_WORD_COUNTWORD_COUNT_TOLERANCErMAX_WORD_COUNTappendERROR_PATTERNSresearchmaxstartendgroupBLACKLIST_PATTERNSminlenreplace MULTILINEfindallloggerwarning) rr r patternmatchcontextr,r-h2_countr6s r validater;Is} Hg&JN%999)*[@PPQR!  N%999 |>.9I K " 99Wg &IIgw/Ec!U[[]R%78599;;KLG#25;;=/AST[S\\`a%  &  '7+ 5;;=2-.Ec'lEIIK"$45CeC(00s;G#6u{{}oYwiW[\%   99Xw 5-. 99Y 6C!   99> H122::i",,?@H!|%z)JKL6*7)456  rtextc`tjdd|}tjdd|}tjdd|}tjdd|}tjdd|}|jDcgc]}t|d kDs|}}t|Scc}w) z4Count words in markdown text, excluding code blocks.z```[\s\S]*?```z`[^`]+`z https?://\S+z\[([^\]]+)\]\([^)]+\)z\1z [#*_\[\]()]r!r)r)subsplitr1)r<wwordss r r#r#s 66#R .D 66*b$ 'D 66/2t ,D 66*E4 8D 66.#t ,D 31A Q 3E 3 u: 4s B+B+cPt|}|j|jxsdfS)z0Quick validation check, returns (valid, reason).OK)r;rr)rresults r quick_checkrFs$ g F <<.$ ..r)__doc__loggingr) dataclassesrtypingr getLoggerrr5rr(r/r$r&r%rr;rr#tuplerrFrrr rMs  !   8 $  0"LcL.L^ss"//tSy!1/r