4MjJOdZddlZddlZddlmZmZddlZej dZdZejdZ de de fd Z d e dee fd Zd e dee fd Zde dzfd Zde fdZGddZy)u: clickup_client.py — ClickUp V2 API client for the Winston quote pipeline (DVI-815). Handles: - Task discovery filtered by date (date_updated, date_created, or due_date) - File attachment upload to a task - Custom field value set (Quote Amount write-back) - Attachment existence check for deduplication N)datetimetimezoneztogen.clickup_clientzhttps://api.clickup.com/api/v2z (\d{2}-\d{4}[A-Z0-9]*(?:_v\d+)?)tagreturncPtjdd|tjS)uStrip trailing version suffix (v1–v99, case-insensitive) from a tag. Mirrors PoC strip_version_suffix: 'xv2' → 'x', 'SHv1' → 'SH'. z v\d{1,2}$)flags)resub IGNORECASE)rs %/var/www/html/togen/clickup_client.pystrip_version_suffixrs 66,Cr}} ==taskc|jdxsgDcgc]H}|jdxsdjr#|jdxsdjJc}Scc}w)zTag names on THIS task only (not subtasks). Used for DEBUG logging so the raw ClickUp `tags` field is visible (DVI-994 point 2).tagsnamer)getstrip)rts r _raw_tag_namesr"sdhhv&," P!%%-2E21L1L1NUU6] b ' ' ) PP PsA A(cg}|jdxsgD]9}|jdxsdj}|s)|j|;|jdxsgD]}|jt |t }g}|D])}||vs|j ||j|+|S)uCollect tag names from a task and all its subtasks recursively. Mirrors PoC _collect_tags: deduplicates, preserves order. Tags are returned as-is (not version-stripped) so callers can log the raw value and strip on demand. NOTE (DVI-994): the ClickUp list/team task endpoints return subtasks as FLAT sibling entries, not nested under a parent's ``subtasks`` key, so this recursion only sees subtasks that a prior per-task detail fetch nested in (see :meth:`ClickUpClient._nest_subtask_tags`). The quote-type tags (``xv1``/``shv2``/…) live on those subtasks, so without nesting this returns ``[]`` for every parent quote task. rrrsubtasks)rrappendextend _collect_tagssetadd)rrrrr seenoutrs r rr)sD XXf  #f #**,  KK xx #)r( M#&'(UDC d? HHSM JJsO Jrc|dvry tjt|dz tjj S#t ttf$rYywxYw)zConvert a ClickUp epoch-millisecond timestamp (str|int) to an ISO-8601 UTC string, or None when absent/unparseable. DVI-972 (diagnostics only).)Nrr0N)tz) r fromtimestampintrutc isoformat ValueError TypeErrorOSError)mss r _ms_to_isor-HsV %%c"gnFPPRR  7 +s>AAAcfc Lt|tsy|jd}|y|jdd}|jdxsi} |dk(rZ|jdxsg}|D]>}|jd|k(s|jd |k(s,|jd |cS|S|d k(rt|trr|jdxsgDcic]4}|jd |jd |jd d6}}|Dcgc]}|j||c}S|d vrFt|tr6|D cgc]*} | jdxs| jdxsd,c} S|Scc}wcc}wcc} w#tt f$r|cYSwxYw)zReturn a human-readable value for a ClickUp custom field, resolving drop_down/labels ids to their option names. DVI-972 (diagnostics only).Nvaluetyper type_config drop_downoptions orderindexidrlabelslabel)usersusernameemail) isinstancedictrlistAttributeErrorr*) r.r0cf_typecfgr4optoby_idvus r _resolve_cf_valuerGSs b$  FF7OE }ffVR G &&  %2C k !ggi(.BG 277<(E1SWWT]e5K776511 2L h :eT#:"wwy17R:UU4[!%%vr1B"CC:E:-23EIIaO3 3 j Zt%!%%.>B>O O L:3O I & sUAFF*F-,F9FFF1F4F /F ;FFF#"F#c eZdZdZdefdZddddeded ed ed eef d Z d ed efdZ deeefded efdZ deeefded efdZ deeefdefdZ ded eefdZdeed dfdZdedeeded dfdZded edzfdZddddeded ed ed eef d Z d)ded!ed"ed#ed ef d$Zded!ed efd%Zded&ed'ed efd(Zy)* ClickUpClientz9Minimal ClickUp V2 client for the Winston quote pipeline.api_keycR|s td||_|dd|_d|i|_y)NzClickUp API key is requiredzapplication/json) Authorizationz Content-TyperL)r)_key _json_headers _bare_headers)selfrJs r __init__zClickUpClient.__init__rs7:; ; $. .w7r date_updatedT) date_fieldinclude_closedlist_id target_daterSrTrc @tj|}tt|j|j|j dddt jjdz}tt|j|j|j dddt jjdz}g}d} |d|dz |d |dzd d d | i} |rd | d < tjtd|d|j| d} | j dk7r1tj#d| j ||| j$ddnN| j'} | jdg} |j)| | jdds| sn| dz } tj+dt-|||||j/||Dcgc]}|j1|c}S#t$rtjd| YswxYwcc}w)zReturn normalized quote-task dicts for tasks matching target_date. target_date : 'YYYY-MM-DD' date_field : 'date_updated' | 'date_created' | 'due_date' rtzinfor#;T_gt_ltrtruepagerTz/list//taskheadersparamstimeoutz/ClickUp get_quote_tasks request error (page %d)z1ClickUp get_tasks failed (%s) list=%s date=%s: %sN,tasks last_pagez6ClickUp: %d task(s) found for list=%s date=%s field=%s)r fromisoformatr&yearmonthdayrr' timestamprequestsr _CLICKUP_BASErN Exceptionlog exception status_codeerrortextjsonrinfolen_nest_subtask_tags _parse_task)rPrUrVrSrTdstart_msend_ms raw_tasksr`rerdatabatchrs r get_quote_taskszClickUpClient.get_quote_taskss  " "; / QVVQWWaeeQ1X\\ J T T VY] ]  QVVQWWaeeRR M W W Y\` ` !# ,c"HqL,c"FQJF )F +1'( LL$oVG9E: ..! }}# GMMFF4CL 668DHHWb)E   U #xx T*% AIDIL  D  N       *-67  #77=  OQUV <8s)-G6H6HHrc|jdd}tj|}|r|jdn|j }|jdgDcic]#}|jddj |%}}|j |ddd}|j|dd d }|j |d d d } | s)|jdg} | r| djdd} |jdxsi} t| tr| jddnd} |j|dd d } |jdxsgDcgc]8}|jdxs|jdxsdj :} }| Dcgc]}|s| } }t|}||jdd||| ||jdd| | | t|jdt|jdt|jd|j|jdg|dScc}wcc}wcc}w)z@Normalize a raw ClickUp task into the fields the pipeline needs.rrr] custom_fieldsr; recipientzcustomer emailamountz quote amounttotal salespersonownerz sales rep assigneesrstatusr:r6url date_createdrRdue_date) quote_numberclickup_task_id task_namerecipient_email owner_emailquote_amount_field_idrr amount_valuerrrRrrr)r _QUOTE_REsearchgrouprlower_cf_str_cf_idr<r= _cf_valuerr-_custom_fields_readable)rPrrmrr. cf_by_namerrrr status_obj status_namerars r r|zClickUpClient._parse_tasks>xx#   T "%&qwwqzDJJL 6:XXor5R' /1BFF62  $ $ & *' ' ,,z7KIYZ $ J.RY Zll:}g{S b1I'l..w; XXh'-2 6@T6RjnnXr2XZ ~~j(NGT hh{+1r UU:  6!%%. 6B = = ?  !*/1QQ/ /T")#xxb1.&%:88E2&!("&txx'?@&txx'?@"488J#78!99$((?TV:WX#  9' $ 0s(I =IIIfieldskeywordsc|D]I}|jD]4\}}||vs |jd}|st|ts0|ccSKy)zGReturn value of the first custom field whose name contains any keyword.r0r)itemsrr<str)rPrrkwrr.rEs r rzClickUpClient._cf_strsT !B"LLN !b:wAZ3/   ! ! rcv|D]4}|jD]\}}||vs |jddccS6y)zDReturn id of the first custom field whose name contains any keyword.r6r)rrrPrrrrr.s r rzClickUpClient._cf_id sG ,B"LLN ,b:66$++ , ,rch|D]-}|jD]\}}||vs t|ccS/y)zGReturn the resolved value of the first custom field matching a keyword.N)rrGrs r rzClickUpClient._cf_valuesA 1B"LLN 1b:,R00 1 1rrcg}|xsgD]9}t|}|ddgfvr|j|jdd|d;|S)zDVI-972: normalize all custom fields to [{name, value}] with human- readable values (drop_down/labels resolved), skipping empty values.Nrr)rr0)rGrr)rPrr r.vals r rz%ClickUpClient._custom_fields_readables]%2 CB#B'CtRn$ JJvr 2SA B  C  rrNc|Dchc]&}|jds|jdd(}}|D]}|jdd}t|}|rtjd||:|r|j |nd}|xsijdxsg}|r ||d<|D]}|j ||dt d|jdgi} tjd|t|| ycc}w) aMutate raw_tasks so each task carries its full nested subtask tree. ANY-DEPTH recursive fetch (DVI-999 / PoC fetch_subtask_names): for tasks with no own tags, calls GET /task/{id}?include_subtasks=true (nests one level), then recursively fetches each subtask's detail so _collect_tags can reach tags at any depth. Uses a visited set seeded with all top-level task IDs to avoid cycles; depth capped at 10. r6rz6ClickUp task %s: own tags=%s (no subtask fetch needed)Nrr])depthz?ClickUp task %s: own_tags=[] nested_subtasks=%d subtask_tags=%s)rrrsdebugget_task_detail_fetch_subtask_treerrz) rPrrvisitedt_idowndetailnestedr sub_tagss r r{z ClickUpClient._nest_subtask_tags(s 7@O155;QUU4_OO A55r?D #C L#37T))$/TFl'' 39rF &* !DC,,S',CD$j!%% B2G%HIH IIQc&k8 ! Ps C?C?subtaskrrcP|dk\ry|jdd}|r||vry|j||j|}|sy|jdxs|jdxsg|d<|jdxsg}||d<|D]}|j|||dzy)aRecursively fetch and attach full detail (tags + children) for a subtask. PoC parity (DVI-999): each level of subtasks may itself have subtasks carrying the quote-type tags, so we drill down until depth>=10 or the visited set closes the cycle. Nr6rrrr])rrrr)rPrrrsub_idrchildrenchilds r rz!ClickUpClient._fetch_subtask_treeGs B; T2&7*  F%%f-  **V,I F0CIr::j)/R&  @E  $ $UGUQY ? @rtask_idcN|sy tjtd||jddid}|jdk7r0t jd |j||jdd y|jS#t$rt j d|YywxYw) zGET a single task with nested subtasks (`include_subtasks=true`). Returns the raw task dict or None on error. Unlike the list/team task endpoints, this nests subtasks under the `subtasks` key. N/task/include_subtasksr_rbrcz-ClickUp get_task_detail request error task=%srgz/ClickUp get_task_detail failed (%s) task=%s: %srh) rprrqrNrrrsrtrurvrwrx)rPrrs r rzClickUpClient.get_task_detail]s    /y1***F3 A ==C  IIA wt  vvx  MMI7 S s.BB$#B$team_idc tj|}tt|j|j|j dddt jjdz}tt|j|j|j dddt jjdz}g}d} |d|dz |d |dzd d d | i} |rd | d < tjtd|d|j| d} | j dk7r1tj#d| j ||| j$ddnN| j'} | jdg} |j)| | jdds| sn| dz } |Dcgc]*}t*j-|jdds)|,}}tj/dt1||||t1||j3||Dcgc]}|j5|c}S#t$rtjd| YwxYwcc}wcc}w)uReturn normalized quote-task dicts queried from a whole team/workspace. Uses GET /team/{team_id}/task — matches the PoC (outlook_auto) approach when no specific list_id is configured. Filters to tasks whose names contain a recognizable quote number pattern to exclude unrelated workspace tasks. target_date : 'YYYY-MM-DD' date_field : 'due_date' | 'date_updated' | 'date_created' rrXr#rZr[Tr\r]r^rr_r`rTz/team/rarbrcz7ClickUp get_quote_tasks_by_team request error (page %d)rgz9ClickUp get_tasks_by_team failed (%s) team=%s date=%s: %sNrhrirjrrzUClickUp: %d task(s) found for team=%s date=%s field=%s (%d total before quote filter))rrkr&rlrmrnrr'rorprrqrNrrrsrtrurvrwrxrrrryrzr{r|)rPrrVrSrTr}r~rrr`rerrrr quote_taskss r get_quote_tasks_by_teamz%ClickUpClient.get_quote_tasks_by_teamwsI"  " "; / QVVQWWaeeQ1X\\ J T T VY] ]  QVVQWWaeeRR M W W Y\` ` !# ,c"HqL,c"FQJF )F +1'( LL$oVG9E: ..! }}# OMMFF4CL 668DHHWb)E   U #xx T*% AIDIP#,SQy/?/?fb@Q/RqS S  c       N    ,-89  #99E  WY]^ .T:s$)-H5(*III5IIfilenamecontent content_typec0 tjtd|d|jd|||fid}|jdvr0t jd |j||jd d yy #t$rt j d|YywxYw) z9Attach a file to a ClickUp task. Returns True on success.rz /attachment attachment<)rdfilesrfz!ClickUp attach_file error task=%sFrgz+ClickUp attach_file failed (%s) task=%s: %sNrhT) rppostrqrOrrrsrtrurvrw)rPrrrrrs r attach_filezClickUpClient.attach_files   /y <**#h%FG A == * II= t     MM=w G s2A33BBc0 tjtd||jd}|jdk(r4|j jdg}t fd|DS y#t$rtjd|YywxYw) zKReturn True if an attachment with this filename already exists on the task.rrb)rdrfrg attachmentsc3rK|].}|jdk(xs|jdk(0yw)title file_nameN)r).0rrs r z2ClickUpClient.attachment_exists..s<EE'Nh.P!%% 2D2PPs47z'ClickUp attachment_exists error task=%sF) rprrqrNrurxanyrrrsrt)rPrrrrs ` r attachment_existszClickUpClient.attachment_existss N  /y1**A }}#ffhll="= ($ N MMCW M NsA-A33BBfield_idr0c 2 tjtd|d||jd|id}|jdvr1t jd |j|||jd d yy #t$rt j d||YywxYw) zr=rr|rrrrr{rr&rrrbytesrrobjectrrr rIrIosC88&)# F8F8F8  F8  F8 dF8P5 5 5 nd39o##T#t)_S$YC T d4j DJ4>@4@#c(@3@SW@,std{>)# N:N:N:  N:  N: dN:r.      :,s6drrI)rloggingr rrrp getLoggerrsrqcompilerrrr=r>rrr-rGrIrrr rs 'g./0  BJJ: ; >c>c>PP$s)Pc>cDj$8ggr