S!h:NdZddlZGddeZGddZGddZy) z This module contains a tokenizer for Excel formulae. The tokenizer is based on the Javascript tokenizer found at http://ewbi.blogs.com/develops/2004/12/excel_formula_p.html written by Eric Bachtal NceZdZdZy)TokenizerErrorz$Base class for all Tokenizer errors.N)__name__ __module__ __qualname____doc__X/var/www/skyplay_api_hub/venv/lib/python3.12/site-packages/openpyxl/formula/tokenizer.pyrr s.r rceZdZdZej dZej dZej dej ddZdZ dZ d Z d Z d Z d Zd ZdZdZdZdZdZdZddZdZdZy) Tokenizera^ A tokenizer for Excel worksheet formulae. Converts a str string representing an Excel formula (in A1 notation) into a sequence of `Token` objects. `formula`: The str string to tokenize Tokenizer defines a method `._parse()` to parse the formula into tokens, which can then be accessed through the `.items` attribute. z^[1-9](\.[0-9]+)?[Ee]$z[ \n]+z"(?:[^"]*"")*[^"]*"(?!")z'(?:[^']*'')*[^']*'(?!')"')z#NULL!z#DIV/0!z#VALUE!z#REF!z#NAME?z#NUM!z#N/Az #GETTING_DATAz,;}) +-*/^&=><%cj||_g|_g|_d|_g|_|j y)Nr)formulaitems token_stackoffsettoken_parse)selfrs r __init__zTokenizer.__init__.s/     r c 2|jry|jsy|jddk(r|xjdz c_n>|jjt |jtj yd|j fd|jfd|jfd|jfd |jfd |jfd |jfd |jfd |jff }i}|D]*\}}|jtj!||,|jt#|jkr|j%r3|j|j}||j&vr|j)||vr|xj||z c_n0|j*j||xjdz c_|jt#|jkr|j)y)z5Populate self.items with the tokens from the formula.Nr=z"'[#  z +-*/^&=><%z{()}z;,)rrrappendTokenLITERAL _parse_string_parse_brackets _parse_error_parse_whitespace_parse_operator _parse_opener _parse_closer_parse_separatorupdatedictfromkeyslencheck_scientific_notation TOKEN_ENDERS save_tokenr)r consumers dispatchercharsconsumer curr_chars r rzTokenizer._parse7s ;; ||  \\!_ # KK1 K JJ  eDLL%--@ A  D&& ' $&& ' $## $ $(( ) 4)) * 4// 0 4%% & 4%% & 4(( )   ( >OE8   dmmE8< = >kkC ----/ T[[1ID---!J& 4z)466  !!), q kkC -- r c|jd|j|j}|dvsJ|j|}|j |j|jd}|$|dk(rdnd}t d|d |j|j d }|dk(r9|jjtj|t|S|jj|t|S) a Parse a "-delimited string or '-delimited link. The offset must be pointing to either a single quote ("'") or double quote ('"') character. The strings are parsed according to Excel rules where to escape the delimiter you just double it up. E.g., "abc""def" in Excel is parsed as 'abc"def' in Python. Returns the number of characters matched. (Does not update self.offset) : can_followrNrstringlinkz%Reached end of formula while parsing z in r) assert_empty_tokenrrSTRING_REGEXESmatchrgrouprr"r# make_operandrr0)rdelimregexrAsubtypes r r%zTokenizer._parse_string_s 3/ T[[) """##E* DLL67 ="'3,hFG #H QUVZVbVbUc!de e A C< JJ  e007 85z JJ  e $5zr c~|j|jdk(sJtjd|j|jdDcgc]}|j df}}tjd|j|jdDcgc]}|j df}}d}t ||zD]W\}}||z }|dk(s|dz}|j j|j|j|j|z|cStd|jcc}wcc}w) z Consume all the text between square brackets []. Returns the number of characters matched. (Does not update self.offset) rz\[Nrz\]rzEncountered unmatched '[' in ) rrrefinditerstartsortedrr"r)rtleftsrights open_countidx open_close outer_rights r r&zTokenizer._parse_brackets{s7||DKK(C///UDLL$>?AA!'')QAA++eT\\$++,%?@Ba1779b/BB %efn5 #OC * $JQ!Ag  !!LLT[[;-FGI""  #t{{m5QUQ]Q]P^^_`aar cP|j|jdvsJ|jjt |j|jtj |j j|j|jdjS)z Consume a string of consecutive spaces. Returns the number of spaces found. (Does not update self.offset). )rr N) rrrr"r#WSPACE WSPACE_RErAendrs r r(zTokenizer._parse_whitespacesv||DKK(K777 % T[[ 95<<HI~~##DLL$>?CCEEr c|j|j|jdzdvrX|jjt |j|j|jdztj y|j|j}|dvsJ|dk(rt dtj }n|dvrt |tj }n|jst |tj}ntdt|jDd}|xr[|jtjk(xs<|jtj k(xs|jtjk(}|rt |tj }nt |tj}|jj|y) z Consume the characters constituting an operator. Returns the number of characters consumed. (Does not update self.offset) )z>=z<=z<>z %*/^&=><+-%z*/^&=>z,Tokenizer._parse_operator..s'4qFFell24s)+Nr)rrrr"r#OP_INOP_POSTOP_PREnextreversedrFCLOSErgOPERAND)rr8rprevis_infixs r r)zTokenizer._parse_operatorsm << DKK!O 48J J JJ  e T[[q9  LL- L(((  #u}}-E ) #)U[[1E)U\\2E4HTZZ$8459;D  +.99 -.99 -  i5i6 % r c|j|jdvsJ|j|jdk(r&|jtj d}nd|j rCdj |j dz}|j dd=tj |}ntj d}|jj||jj|y)z Consumes a ( or { character. Returns the number of characters consumed. (Does not update self.offset) )({rvrVruNr) rrr?r# make_subexprrZrr"r)rr token_values r r*zTokenizer._parse_openers||DKK(J666 << $ +  # # %%%c*E ZZ''$**-3K 1 %%k2E%%c*E %  &r c@|j|jdvsJ|jjj }|j |j|jk7rt d|jz|jj|y)z Consumes a } or ) character. Returns the number of characters consumed. (Does not update self.offset) ))}zMismatched ( and { pair in '%s'r) rrrpop get_closervaluerrr")rrs r r+zTokenizer._parse_closers||DKK(J666  $$&113 ;;$,,t{{3 3 1DLL@B B % r c|j|j}|dvsJ|dk(rtjd}n^ |jdj }|tj k(rtdtj}ntjd} |jj|y#t$rtdtj}YAwxYw)z Consumes a ; or , character. Returns the number of characters consumed. (Does not update self.offset) );,rrHrr) rrr#make_separatorrrgPARENrk IndexErrorrr")rr8rtop_types r r,zTokenizer._parse_separatorsLL- J&&&  ((-E 6++B/44u{{*!#u{{3E!005E %  0c5;;/ 0sB55#CCc8|j|j}|dvr}t|jdk\re|jj dj |jr1|jj||xjdz c_yy)z Consumes a + or - character if part of a number in sci. notation. Returns True if the character was consumed and self.offset was updated, False otherwise. z+-rrVTF)rrr0rSN_RErArZr")rr8s r r1z#Tokenizer.check_scientific_notationssLL-   Oq(JJ$$RWWTZZ%89 JJ  i ( KK1 Kr c|jr8|jd|vr&td|jd|jdyy)a: Ensure that there's no token currently being parsed. Or if there is a token being parsed, it must end with a character in can_follow. If there are unconsumed token contents, it means we hit an unexpected token transition. In this case, we raise a TokenizerError rHz!Unexpected character at position rWrN)rrrr)rr<s r r?zTokenizer.assert_empty_token'sJ ::$**R. : #DT[[MQVW[WcWcVdde!fg g;:r c|jrW|jjtj dj |j|jdd=yy)z9If there's a token being parsed, add it to the item list.rVN)rrr"r#rCrZras r r3zTokenizer.save_token5sC :: JJ  e001DE F 1  r c|jsy|jdjtjk(r|jdjSddj d|jDzS)z+Convert the parsed tokens back to a string.rVrrc34K|]}|jywrf)r~)rhrs r rjz#Tokenizer.render..AsAUU[[As)rrgr#r$r~rZras r renderzTokenizer.render;sXzz ZZ]  5== 0::a=&& &RWWAdjjAAAAr N)r )rrrrrIcompilerr_r@rXr2rrr%r&r'r(r)r*r+r,r1r?r3rr r r r r s  BJJ0 1E 9%I RZZ2 3 RZZ2 3 N5K$L&P8M2b$ F$L, 2" h Br r ceZdZdZgdZdZdZdZdZdZ dZ d Z d Z d Z d Zdd ZdZdZdZdZdZdZedZdZdZeddZdZdZdZedZy)r#a) A token in an Excel formula. Tokens have three attributes: * `value`: The string value parsed that led to this token * `type`: A string identifying the type of token * `subtype`: A string identifying subtype of the token (optional, and defaults to "") r~rgrFr$rqFUNCARRAYrSEPzOPERATOR-PREFIXzOPERATOR-INFIXzOPERATOR-POSTFIXz WHITE-SPACEc.||_||_||_yrfr)rr~type_rFs r rzToken.__init___s   r TEXTNUMBERLOGICALERRORRANGEcddj|j|j|jS)Nz {0} {1} {2}:)formatrgrFr~ras r __repr__zToken.__repr__qs#%%diitzzJJr c*|jdr |j}nG|jdr |j}n)|dvr |j}n t ||j }|||j|S#t $r|j}Y+wxYw)zCreate an operand token.rr)TRUEFALSE) rYrrrfloatr ValueErrorrrqclsr~rFs r rCzToken.make_operandts   C hhG   c "iiG ' 'kkG $e **5#++w// $)) $sA::BBOPENrpc*|ddvsJ|r)tjd|sJtj}n:|dvrtj}n%|dvrtj }ntj}|dvr |j n |j}||||S)z Create a subexpression token. `value`: The value of the token `func`: If True, force the token to be of type FUNC rH)rvr{rurzz.+\(|\)z{}z()r!)rIrAr#rrrrpr)rr~funcrrFs r rwzToken.make_subexpsRy0000 88K/ //JJE d]KKE d]KKEJJE$}#))#((5%))r c(|j|j|j|jfvsJ|j|j k(sJ|j|jk(rdnd}|j ||j|jk(S)z6Return a closing token that matches this token's type.r{rz)r)rgrrrrFrrw)rr~s r r}zToken.get_closersvyyTYY DJJ????||tyy(((yyDJJ.CDII,BCCr ARGROWcp|dvsJ|dk(r |jn |j}|||j|S)zCreate a separator token)rrr)rrrrs r rzToken.make_separators: """"c\#''sww5#''7++r N)rV)F)rrrr __slots__r$rqrrrrrmrkrlr^rrrrrrr classmethodrCrrprwr}rrrr r r r#r#Ds -IGG D E E C F E G F D FG E EK002 D E***D C C,,r r#)rrI Exceptionrr r#r r r rs6 /Y/qBqBh z,z,r