Gіi2dZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z eje ZdZdZdZd d gZdZd Zd Zej,d Zej,dej0ZdedefdZdedefdZdedeededeefdZ dedededeeefde!ee"ff dZ# d$dedededefdZ$dede!eeeefffdZ%dedeeefdefd Z& d%deded!e ed"e edede!eeff d#Z'y)&z Internal link injection for SEO optimization. Finds related published articles and injects markdown links. Uses LLM-based anchor text suggestion via Gemini Flash. N)Path)Optional)PublishedContentRepositoryizgemini-3-flash-previewzgemini-2.5-flashi:z\[([^\]]+)\]\([^\)]+\)z^(#{1,6}\s+.*)$ word_countreturncLtttt|tzS)z5Calculate dynamic link count based on article length.)max MIN_LINKSmin MAX_LINKSLINKS_PER_WORDS)r s @/var/www/html/content-pipeline/modules/internal_link_injector.py_calculate_max_linksr%s y#i)FG HHfilenamecttjjdz |z }|jst d||j S)z,Load prompt template from prompts directory.promptszPrompt file not found: )r__file__parentexistsFileNotFoundError read_text)r prompt_paths r _load_promptr*sOx.''..:XEK    "9+ GHH  ""rcontenttargets max_linkscd ddlm}ddlm}ddlm}|}g}t} |D]O} | jddxsd} |jd | d d | d d | dd| j| d Qdj|} |dt} t|tkDr| dz } t!d}|j#|| | }d}t$D]Q}t&}t)t*D]2} |j,j/|||j1d}nN|Qn|r |j8stjd#gS|j8j;}|j=d$r.t?j@d%d|}t?j@d&d|} tCjD|}tI|tJstjd)gSg}|jM}|D]6}tI|tNs|jd*dj;}|jd+dj;}|r|sZ|| vrtjQd,|d-xt|jSdkst|jSd.kDrtjQd/|d0d1t?jT|d1}t?jV||t>jXstjQd/|d2#|j||d39tj[d4t|d5t||S#t $r$}tjd|gcYd}~Sd}~wwxYw#t $r$}tjd|gcYd}~Sd}~wwxYw#t $r}dt3|vs dt3|vro|t*dz krItjd|d|dzdt*d|d t5j6||dz}Yd}~Ltjd |d!ntjd |d"|Yd}~Rd}~wwxYw#tBjF$r tjd'|dd(gcYSwxYw)6aU Use Gemini Flash to find natural anchor text phrases in article content. Args: content: Article markdown content targets: List of link target dicts (slug, title, summary) max_links: Maximum links to suggest Returns: List of validated suggestions: [{"anchor_text": ..., "target_slug": ...}] r)genai)types)get_gemini_clientz8Could not initialize Gemini client for link suggestion: Nsummaryz- Slug: slugz | Titel: titlez | Thema:  u [... Artikel gekürzt ...]zinternal_links.txt)r rarticle_contentz&Could not load internal links prompt: g333333?) temperature)modelcontentsconfig429RESOURCE_EXHAUSTEDzRate limited on z (attempt /z ), waiting szModel z exhausted retries, falling backz failed: z+All LLM models failed for anchor suggestionz```z^```(?:json)?\s*\n?z \n?```\s*$z'LLM returned invalid JSON for anchors: z LLM response is not a JSON array anchor_text target_slugzLLM suggested unknown slug 'z ', skippingz LLM anchor 'z ' has wrong word count, skippingz\bz)' not found verbatim in article, skipping)r7r8zLLM suggested z anchors, validated ).googler" google.genair#modules.article_generatorr$ ExceptionloggerwarningsetgetappendaddjoinMAX_CONTENT_CHARSlenrformat LLM_MODELSLLM_INITIAL_DELAYrangeLLM_MAX_RETRIESmodelsgenerate_contentGenerateContentConfigstrtimesleeptextstrip startswithresubjsonloadsJSONDecodeError isinstancelistlowerdictdebugsplitescapesearch IGNORECASEinfo)rrr r"r#r$cliente target_lines target_slugstr% targets_texttrimmed_contentprompt_templatepromptresponser-delayattemptraw_text suggestions validated content_lowerr4anchorr'patterns r_suggest_anchors_with_llmrv2s  &?"$ L5L $%% 2&,"hqykAgJfüramiminzuaufdasdemdenderdesdieeinmitundvoneiner)rr5r2r z, ) r_rSr\rUrJrFrDr rBrC)rrr(kkeywordskeywords_lowersegments stopwordsadded_from_titlesegment segment_wordsniphrase phrase_wordswnon_stops rextract_linkable_keywordsrs&$2#7#7#<Ja  JHJ)12Aaggi2N2 88,e4J  .G#MMO113M .s=1A59: .A'1, XXmAA&>?F#)<<>#7#7#9L+7Na1I;MNHN8}Aq1u 5&,,.P^:^ /&**6<<>:(A-( . . . 99X /K2 OsF F F? F F crifd}tj||}tj||}|fS)zOReplace existing markdown links and headings with placeholders to protect them.czdtjjddd}|jd|<|S)Nr|rr}r)rrrr)rrrxs r replace_matchz._protect_existing_links..replace_matchs=$TZZ\%5%5bq%9$:"= $)KKN [!r) LINK_PATTERNrVHEADING_PATTERN)rr protectedrxs @r_protect_existing_linksr s>L   8I##M9=I l ""rcZ|jD]\}}|j||}|S)z)Restore original links from placeholders.)itemsreplace)rrxroriginals r_restore_linksrs4!-!3!3!59 X//+x89 Nrcontent_cluster exclude_wp_idc|jdDcgc]1}|js|jj3}}|stj d|dfSt j ||}|stj d|dfS|dkDr t|nt}t|\} } d} t} t} | }t|||}|Dcic]}|d| }}|D]}| |k\rn|d}|d}|j|}|r|d | vr/|j| vrBd |d }t|||| \}}|s\| d z } | j|d | j|jtj d |d|t|| }tj!d| d|| fScc}wcc}w)aS Inject internal links to related published articles. Uses Gemini Flash to suggest natural multi-word anchor phrases that semantically match the target articles. Args: content: Markdown content to inject links into topic_keywords: Comma-separated keywords for the current topic content_cluster: Content cluster for relevance filtering exclude_wp_id: WordPress post ID to exclude (current article) word_count: Article word count for dynamic link calculation Returns: Tuple of (modified content, number of links injected) rz'No keywords provided for link injectionr)clusterrzNo link targets foundr'r8r7 wp_post_idz/blog/r3r2zLinked 'z' -> z Injected z internal links)r_rSr\r>r^rget_link_targetsrr rr@rvrArrCrrc)rrrrr rrrr protected_contentrxlinks_injected linked_ids used_anchorsmodified_contentllm_suggestionsrhslug_to_target suggestionr'r7targetrwsuccesss rinject_internal_linksr$s.,:+?+?+DRa  !RHR  >?z(99#G  ,-z4>N$Z0 I'>g&F#|NJ5L(0)LO-44qail4N4%= Y & -( / ##D) -;     , . tfA$< k3 % !'  a N NN6,/ 0   [..0 1 LL8K=cU; <-=2&&6 E KK)N+?;< ^ ++uS85sG G& G)r&)NNr)(__doc__rWloggingrUrPrpathlibrtypingrdatabase.modelsr getLogger__name__r>rr rrHrKrIrEcompiler MULTILINErintrrOrr[r]rvtupleboolrrrrrrrrs    6   8 $  '(: ; rzz34 "**/>ISISI #3#3#C C $ZCC $Z CL$ $$ $sCx. $  39 $T* ** * *Z#S#U3S#X3F-G#"CtCH~#&*#' Q, Q,Q,c]Q,C= Q,  Q,  38_ Q,r