a g gg@s&dZddlZddlmZddlmZmZddlmZm Z ddl m Z m Z m Z mZmZmZmZddlmZmZmZmZddlmZmZmZdd lmZmZmZmZm Z m!Z!m"Z"dd l#m$Z$m%Z%m&Z&dd l'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1m2Z2m3Z3m4Z4m5Z5m6Z6m7Z7m8Z8m9Z9m:Z:m;Z;mZ>m?Z?m@Z@mAZAmBZBmCZCmDZDdd lEmFZFdd lGmHZHmIZImJZJmKZKmLZLddlMmNZNmOZOmPZPmQZQmRZRmSZSmTZTddlUmVZVddlWmXZXmYZYeZZ[eeXeYfZ\GdddeNZ]Gddde0eZ^d_ee%e e$e edddZ_GdddeZ`ee e$e%e edddZad`ee%e e$e e[e eddd Zbdaee e[ed!d"d#Zcdbeee%e e$e e[e ed$d%d&Zdee%eed'd(d)Zfeeedd*d+d,Zge eXeeXe`ed-d.d/ZheSeSd0d1d2ZieeeZd3d4d5ZjeeeZeed6d7d8Zkeiee e$e%e ed9d:d;Zleiee e$e%e ed9dd?d@ZneYeeoe%e e$ddAdBdCZpeYe\eZddDdEdFZqeYddGdHdIZreYe%e e$ddJdKdLZseYeYddMdNdOZtdce\e\eeeedQdRdSZueeXeedTdUdVZveeZe ee[dWdXdYZwdZd[eeSe%e e$eoe ed\d]d^ZxdS)dz Generating lines of code. N)replace)Enumauto)partialwraps) CollectionIteratorListOptionalSetUnioncast)COMMA_PRIORITY DOT_PRIORITY#get_leaves_inside_matching_bracketsmax_delimiter_priority_in_atom)FMT_OFFgenerate_comments list_comments)Line RHSResult append_leaves can_be_splitcan_omit_invisible_parensis_line_short_enoughline_to_string)FeatureModePreview) ASSIGNMENTSBRACKETSCLOSING_BRACKETSOPENING_BRACKETSRARROWSTANDALONE_COMMENT STATEMENT WHITESPACEVisitorensure_visible is_arith_likeis_async_stmt_or_funcdefis_atom_with_invisible_parens is_docstringis_empty_tuple is_lpar_tokenis_multiline_string is_name_tokenis_one_sequence_between is_one_tuple is_rpar_token is_stub_body is_stub_suiteis_tuple_containing_walrus is_varargis_walrus_assignmentis_yieldsymswrap_in_parentheses)normalize_numeric_literal) fix_docstringget_string_prefixnormalize_string_prefixnormalize_string_quotes"normalize_unicode_escape_sequences)CannotTransform StringMergerStringParenStripperStringParenWrapperStringSplitter Transformer hug_power_op)token)LeafNodec@seZdZdZdS) CannotSplitzBA readable split that fits the allotted line length is impossible.N)__name__ __module__ __qualname____doc__rQrQP/var/www/html/llm_bihealth/app/venv/lib/python3.9/site-packages/black/linegen.pyrLSsrLcseZdZdZeeeddddZd4ee e ddd Z e e e d fd d Z ee e d d dZee e d ddZee e d ddZeeeeee e dddZee e d ddZee e d ddZee e d ddZee e d ddZee e d ddZee e d d d!Zee e d d"d#Zee e d d$d%Zee e d&d'd(Zee e d&d)d*Zee e d&d+d,Z ee e d d-d.Z!ee e d&d/d0Z"dd1d2d3Z#Z$S)5 LineGeneratorzGenerates reformatted Line objects. Empty lines are not emitted. Note: destroys the tree it's visiting by mutating prefixes of its leaves in ways that will no longer stringify to valid Python code on the tree. N)modefeaturesreturncCs||_||_||dSN)rTrU __post_init__)selfrTrUrQrQrR__init__`szLineGenerator.__init__r)indentrVccsp|js|jj|7_dStj|jvrJt|jjdkrJt|jjdrJdS|j}t|j|j|d|_|VdS)zGenerate a line. If the line is empty, only emit if it makes sense. If the line is too long, split it first and then generate. If any lines were generated, set up a new current_line. NrrTdepth) current_liner^r"improved_async_statements_handlingrTlenleavesr*r)rYr[Z complete_linerQrQrRlinefs  zLineGenerator.linenoderVc#st|tr|jj}t|D]f}|r4|j|q|jtj kr\|j|| EdHq| EdH|j|| EdHqt ||d|j j r|jtjkrt|j|_t|j|_|jtjkrt||jtvr|j|t|EdHdS)zCDefault `visit_*()` implementation. Recurses to children of `node`.Ninside_brackets) isinstancerJr_bracket_trackerany_open_bracketsrappendtyperICOMMENTrcnormalize_prefixrTstring_normalizationSTRINGr?valuer@NUMBERr<r&super visit_default)rYrerjcomment __class__rQrRrts(            zLineGenerator.visit_defaultccsftj|jvrR|jo|jjtjk}|sRttjd}ttjd}| d|| || |EdHdS)zVisit an `x if y else z` testrN) rZ$parenthesize_conditional_expressionsrT prev_siblingrlrILPARrJRPAR insert_child append_childrt)rYreZalready_parenthesizedlparrparrQrQrR visit_tests     zLineGenerator.visit_testccs$|dEdH||EdHdS)z/Increase indentation level, maybe yield a line.r\NrcrtrYrerQrQrR visit_INDENTszLineGenerator.visit_INDENTccs2|EdH||EdH|dEdHdS)z/Decrease indentation level, maybe yield a line.NrrrQrQrR visit_DEDENTszLineGenerator.visit_DEDENT)rekeywordsparensrVccsTt|||j|jd|jD]4}t|r>|j|vr>|EdH||EdHqdS)aVisit a statement. This implementation is shared for `if`, `while`, `for`, `try`, `except`, `def`, `with`, `class`, `assert`, and assignments. The relevant Python language `keywords` for a given statement will be NAME leaves within it. This methods puts those on a separate line. `parens` holds a set of string leaf values immediately after which invisible parens should be put.  parens_afterrTrUN)normalize_invisible_parensrTrUchildrenr0rqrcvisit)rYrerrchildrQrQrR visit_stmts  zLineGenerator.visit_stmtccstj|jvrt|jD]r\}}|dkr(q|j|djtjkr|jtj krz|jdjtj krzt ||ddrt ||ddqt ||ddq| |EdHdS)Nrr\Fparentremove_brackets_around_commaZvisible)rZwrap_long_dict_values_in_parensrT enumeraterrlrICOLONr:atomrz#maybe_make_parens_invisible_in_atomr;rt)rYreirrQrQrRvisit_dictsetmakers z LineGenerator.visit_dictsetmakerccs|EdHd}|jD]h}|jtjkr.d}q|r|jtjkrn|jdjtjkrnt||ddr|t ||ddnt ||ddd}q|jD]}| |EdHqdS)zVisit function definition.NFTrrr) rcrrlrIr#r:rrzrr;r)rYreZis_return_annotationrrQrQrR visit_funcdefs"   zLineGenerator.visit_funcdefccsDt|t|j|jd|EdH|jD]}||EdHq*dS)z'Visit either a match or case statement.rN)rsetrTrUrcrrrYrerrQrQrRvisit_match_cases  zLineGenerator.visit_match_caseccs<|jjr(t|r(||jdEdHn||EdHdS)zVisit a suite.N)rTis_pyir5rrrtrrQrQrR visit_suite szLineGenerator.visit_suiteccsd}|jD]2}|dus |tjkr6t|r6t||dd|j}q |joN|jjtv}|r|jj rvt |rv| |EdHq| dEdH| |EdH| dEdHn6|jj r|jrt |js| EdH| |EdHdS)z,Visit a statement without nested statements.NFrr\r)rrISEMIr)r;rlrr%rTrr4rtrcr5)rYreZ prev_typerZ is_suite_likerQrQrRvisit_simple_stmts( zLineGenerator.visit_simple_stmtccs|EdHt|j}|D].}||EdH|jtjksF|jtkrqLqt|}t j |j vrr||EdHn|jD]}||EdHqxdS)z-Visit `async def`, `async for`, `async with`.N) rciterrrrlrIASYNCr$nextrr`rT)rYrerrZ internal_stmtrQrQrRvisit_async_stmt.s   zLineGenerator.visit_async_stmtccs.|jD]"}|EdH||EdHqdS)zVisit decorators.N)rrcrrrQrQrRvisit_decoratorsBs zLineGenerator.visit_decoratorsccst|jddD]r\}}|j|d}t|ts4q|j}|jtjkr|jt j kr|jdjtj kr| dsd|vrt ||qt|||EdHdS)Nrr\r)0x0bZ0oj)rrrhrJrqlowerrlrIrrr:trailerDOT startswithr;remove_await_parensrt)rYreidxleafZ next_leafrqrQrQrR visit_powerHs$     zLineGenerator.visit_powerrrVccs|EdHdS)zBRemove a semicolon and put the other statement on a separate line.N)rcrYrrQrQrR visit_SEMI`szLineGenerator.visit_SEMIccs"||EdH|EdHdS)zAEnd of file. Process outstanding comments and end with a newline.N)rtrcrrQrQrRvisit_ENDMARKERdszLineGenerator.visit_ENDMARKERccs.|jjs|EdH||EdHdSrW)r_rirjrcrtrrQrQrRvisit_STANDALONE_COMMENTis z&LineGenerator.visit_STANDALONE_COMMENTccs|j\}}|jtjkrtt|jdkrt|jdjtjkrtttjd}ttj d}| pXd}| |t tj |||g||EdHdS)z_Force parentheses between a unary op and a binary power: -2 ** 8 -> -(2 ** 8) r\()rN)rrlr:powerrarI DOUBLESTARrJrzr{remover|rKrrt)rYre _operatoroperandr~rindexrQrQrR visit_factorns      zLineGenerator.visit_factorc cstj|jvrt|t|rd|jvr|jjrFt|j}t|}n|j}t |}|t |d}|d}|d|kr|dnd}||| }| }d|j j }t |rt||}n|}d}|r*|d|krd|}|d|kr|d7}|dd kr4t |t |d } | d r4|d7}d }n |s4d}||} |jr|dkr|} |rht | dnd} t | dkr| ||jjkrt |||jjkr|s|| |d || |_n|| || |_n|| || |_||EdHdS) Nz\ rr\rz F r\rT )rZhex_codes_in_unicode_sequencesrTrAr,rqror?r@r>rar_r^r/r=striprstrip splitlines line_lengthrt) rYr docstringprefix quote_charZ quote_lenZdocstring_started_emptyr[Zhas_trailing_backslashZbackslash_countquotelinesZlast_line_lengthrQrQrR visit_STRINGs\         zLineGenerator.visit_STRING)rVcCs0t|jd|_|j}t}t|dhddhd|_t|hdddhd|_t|dd hdhd|_t|d d hd d hd|_ t|hd |d|_ t|d hd hd|_ t|dhdhd|_ t|dh|d|_ t||td|_t|dhdhd|_t||dhd|_t||dhd|_|j|_|j|_|j|_|j|_dS)z,You are in a twisty little maze of passages.rTassert,)rr>ifelseelifrrwhilerforin>exceptrtryfinallyrwithclassrVimportdelN)rrTr_rrrZvisit_assert_stmtZ visit_if_stmtZvisit_while_stmtZvisit_for_stmtZvisit_try_stmtZvisit_except_clauseZvisit_with_stmtZvisit_classdefrZvisit_expr_stmtZvisit_return_stmtZvisit_import_fromZvisit_del_stmtrZvisit_async_funcdefrZvisit_decoratedrZvisit_match_stmtZvisit_case_block)rYvØrQrQrRrXs. zLineGenerator.__post_init__)r)%rMrNrOrPrrrrZintrrrcLNrtrKrrJrrr strrrrrrrrrrrrrrrrX __classcell__rQrQrvrRrSYs0  SrSrQ)rcrTrUrVc cs|jr|VdSt|}|j}|j}t||}t||}t||}t||} |s|j s|j st |||dsv| r|j r|stj|vr||g} ng} n|jrtg} ntttttttddd} tddd| i} tj|vr|j r|||tt| | g} n|||| | g} n|j r(tt| g} n| g} | t| D]H} zt|| |||d }WntypYq._rhsrhsrQ__call__r) Z is_commentrrrorCrDrFrE$contains_uncollapsable_type_commentsshould_split_rhsmagic_trailing_commar!contains_unsplittable_type_ignorergcontains_standalone_commentsrZstring_processingis_defleft_hand_splitobjectrrrrrrldelimiter_splitstandalone_comment_splitrkrHrun_transformerrB)rcrTrUrZllZsnZ string_mergeZstring_paren_stripZ string_splitZstring_paren_wrapZ transformersrr transformresultrQrQrRtransform_linesz                 rc@seZdZeZeZeZdS)_BracketSplitComponentN)rMrNrOrheadbodytailrQrQrQrRresr)rc _featuresrTrVc csg}g}g}|}d}|jD]j}||ur`|jtvr`|j|ur`t|tr`t|t||r\|n|}||||ur|jtvr|}|}q|st dt |||t j d} t |||t j d} t |||t jd} t| | | | | | fD]} | r| VqdS)a/Split line into many lines, starting with the first matching bracket pair. Note: this usually looks weird, only use this for function definitions. Prefer RHS otherwise. This is why this function is not symmetrical with :func:`right_hand_split` which also handles optional parentheses. NNo brackets found component)rbrlr!opening_bracketrhrJr(rkr"rLbracket_split_build_linerrrr bracket_split_succeeded_or_raise) rcrrT tail_leaves body_leaves head_leavescurrent_leavesZmatching_bracketrrrrrrQrQrRrksJ         r)rcrTrUrrVccs(t||d}t|||||dEdHdS)aXSplit line into many lines, starting with the last matching bracket pair. If the split was by optional parentheses, attempt splitting without them, too. `omit` is a collection of closing bracket IDs that shouldn't be considered for this split. Note: running this function modifies `bracket_depth` on the leaves of `line`. rrUrN)_first_right_hand_split%_maybe_split_omitting_optional_parens)rcrTrUrZ rhs_resultrQrQrRrs  r)rcrrVc Csg}g}g}|}d}d}t|jD]V}||urB||urB|r>|n|}||||ur"|jtvr"t||vr"|j}|}|}q"|r|r|std|||t |||t j d} t |||t j d} t |||t j d} t| | | t| | | ||S)a#Split the line into head, body, tail starting with the last bracket pair. Note: this function should not have side effects. It's relied upon by _maybe_split_omitting_optional_parens to get an opinion whether to prefer splitting on the right side of an assignment statement. Nrr)reversedrbrkrlr!idrrLreverserrrrrrr) rcrrrr r rclosing_bracketrrrrrQrQrRr s@        r )rrcrTrUrrVc cstj|vr|jjtjkr|jjs|jjtjkr|jjs|j s|j dst ||j rt|jh|}zt||d}tj|jvrt|jjdkr|jjdjtjkrtdd|jjddDrt|jt||j dd d r|jjdurt||r.t|||||d EdHWdSWnpty}zVt|j sjt|j |d sjtd |n"|js|j rtd |WYd}~n d}~00t!|jt!|j|j|j |j fD]}|r|VqdS)Nrrrcss|]}|jtvVqdSrW)rlr .0rrQrQrR z8_maybe_split_omitting_optional_parens..rr\)rrr z.r) rrrbrlrIrr!rrrrr)rrTZ has_closing_bracket_after_assignrrQrQrRr+s"      r)rrrrVcCsBtt|}|s>|dkr&tdn|dkr>td|ddS)aRaise :exc:`CannotSplit` if the last left- or right-hand split failed. Do nothing otherwise. A left- or right-hand split is based on a pair of brackets. Content before (and including) the opening bracket is left on one line, content inside the brackets is put on a separate line, and finally content starting with and following the closing bracket is put on a separate line. Those are called `head`, `body`, and `tail`, respectively. If the split produced the same line (all content in `head`) or ended up with an empty `body` and the `tail` is just the closing bracket, then it's considered failed. rz)Splitting brackets produced the same linerz,Splitting brackets on an empty body to save z characters is not worth itN)rarrrL)rrrZtail_lenrQrQrRrHs  r)rboriginalrrrVc Csvt|j|jd}|tjurd|_|jd7_|rt|ddd|jo|jdkot dd|D ot d d|dj t |dj d d fD }|j s|rt t|dd d D]D}||jtkrq||jtjkrttjd }||d|qqt}|tjurt|}|D]>} |j| dt| |vd|| D]} |j| ddq:q|tjurrt||rrd|_|S)aiReturn a new line with given `leaves` and respective comments from `original`. If it's the head component, brackets will be tracked so trailing commas are respected. If it's the body component, the result line is one-indented inside brackets and as such has its first leaf's prefix normalized and a trailing comma added when expected. r]Tr\rrfrcss|]}|jtjkVqdSrW)rlrICOMMArrQrQrRr~rz+bracket_split_build_line..css0|](}t|trt|jtr|jjtkVqdSrW)rhrKryrJrlr#)rrerQrQrRrsrNrr) preformattedZ track_bracketr!)rrTr^rrrgrnrrqrrgetattrrrangerarlr$rIr rJinsertrrrrkrcomments_aftershould_split_liner) rbrrrrZ no_commasr new_commaZleaves_to_trackr comment_afterrQrQrRrbsR      r) split_funcrVcs,tttttttdfdd }|S)zNormalize prefix of the first leaf in every line returned by `split_func`. This is a decorator over relevant split functions. rcrUrTrVc3s.|||D]}t|jddd|Vq dS)NrTrf)rnrb)rcrUrTZ split_liner*rQrR split_wrappersz0dont_increase_indentation..split_wrapper)rrrrrr)r*r-rQr,rRdont_increase_indentations  r.)rcrVcCs8tt|jdddD]}|j|jtkr|SqdS)Nr\rr)r$rarbrlr$)rcleaf_idxrQrQrR_get_last_non_comment_leafs r0)safedelimiter_priorityrcrVcCsH|rD|tkrD|jdjtjkrD|jdjtkrDttjd}|||S)Nrr)rrbrlrIr r$rJrk)r1r2rcr(rQrQrR_safe_add_trailing_commas  r3r+c#szjd}Wnty*tddYn0j}z|jt|hd}WntydtddYn0|tkr||dkrtdt j j j dt j}d }ttt d fd d }t} tjD]\} } || EdH| D]} || EdHqt|| j}| j|krdt| tjhd r>|o:tj|v}n&t| tjtjhd rd|obtj|v}tj|vr|j t!kr| | krt"|||j#$t| } | |krΈVt j j j dqΈrt"||VdS)zSplit according to delimiters of the highest priority. If the appropriate Features are given, the split will add trailing commas also in function signatures and calls that contain `*` and `**`. rz Line emptyNexcludezNo delimiters foundr\z7Splitting a single attribute from its owner looks wrongrTr^rgTrc3sNzj|ddWn6tyHVtjjjd|Yn0dS)EAppend `leaf` to current line or to new line if appending impossible.Tr"r6NZ append_safe ValueErrorrrTr^rgrkrr_rcrQrRappend_to_lines  z'delimiter_split..append_to_line)Zwithin)%rb IndexErrorrLrimax_delimiter_priorityrr9rZdelimiter_count_with_priorityrrTr^rgsysmaxsizerJrr0rr&minZ bracket_depthr7r:Z typedargslistrZTRAILING_COMMA_IN_DEFZarglistargumentZTRAILING_COMMA_IN_CALLrZadd_trailing_comma_consistentlyrlr$r3 delimitersget)rcrUrT last_leafZbtr2Z lowest_depthZtrailing_comma_safer<Zlast_non_comment_leafr/rr)Z leaf_priorityrQr;rRrsf        rc#sdstdtjjjdtttdfdd }jD]0}||EdH |D]}||EdHqbqFrVdS)z4Split standalone comments from the rest of the line.rz*Line does not have any standalone commentsr6rc3sNzj|ddWn6tyHVtjjjd|Yn0dS)r7Tr")r^rgNr8r:r;rQrRr<0s  z0standalone_comment_split..append_to_lineN) rrLrrTr^rgrJrrbr&)rcrUrTr<rr)rQr;rRr$s   r)rrgrVcCsV|sL|jd}d|dvrL|dd}t|dkr>|d8}d||_dSd|_dS) zLeave existing extra newlines if not `inside_brackets`. Remove everything else. Note: don't use backslashes for formatting or you'll lose your voting rights. #rrrrr\Nrx)rsplitcountra)rrgZsplZnl_countrQrQrRrnGs    rn)rerrTrUrVc Cst|jddD]}|jtvrdSq|jtjkr.rN) rlr:rrr;rhrrKrOrUZ asexpr_testrrb)rerrrQrQrRrO s,    rOF)rerrrVc Cs|jtjksHt|sHt|sHt|r0|jtjksH|s@t|tksHt |rLdSt |r|jtj tjtj tj tjtjtjtjtjtjf vrdS|jd}|jd}t|rt|r|jd}d|_d|_t|||dt|r||jddSdS)a If it's safe, make the parens in the atom `node` invisible, recursively. Additionally, remove repeated, adjacent invisible parens from the atom `node` as they are redundant. Returns whether the node should itself be wrapped in invisible parentheses. Frrr\rxrT)rlr:rr-r2r9Z expr_stmtrrr6r8rLZ assert_stmtZ return_stmtrSZfuncdefrJrMZdel_stmtrr.r3rqrr+r)rerrfirstlastZmiddlerQrQrRr7s\         r)rcrrVc Cs|jr|jdvsdSt}d}z:|jd}|jtjkrHd}|t||j j |d}Wnt t fypYdS0|t ko|jjr|p|jjtjtjhvS)zFShould `line` be immediately split with `delimiter_split()` after RHS?z[{(FrTr4)rrqrrbrlrIr addrrir>r=r9rrTrr:rrP)rcrr5Ztrailing_commarEZ max_priorityrQrQrRr'ys    r')rcrrVc cst}|js|Vd|j}d}d}t}|jddD]~\}}} || 7}||krXq| t|jt|jk} |jtks~| rq|r||urd}nb|jt vr|dkr|j |dnd} | r| jt j kr|j durt|j ||j sq|t|q6|jt vr6|dkr|j |dnd} | rB| jtvrB|t|q6|rn|t|||||V| r| jt j kr|j durt|j ||j sq|jr6|j }|}q6dS)aGenerate sets of closing bracket IDs that should be omitted in a RHS. Brackets can be omitted if the entire trailer up to and including a preceding closing bracket fits in one line. Yielded sets are cumulative (contain results of previous yields, too). First set is empty, unless the line should explode, in which case bracket pairs until the one that needs to explode are omitted. NT)rrr\)rrr^Zenumerate_with_lengthrarqrrlr$r!rbrIr rr1rZrr"updateclear) rcrrlengthrrZinner_bracketsrrZ leaf_lengthZhas_inline_commentprevrQrQrRrsj         rrxr)rcrrTrUrrVc s(|s t|}g}|||D]2}t|d|kr:td|t||dqt|}tj|vs|j j dks|j j rt dd|j j Ds|s|ds|dst|ddst d d|jDr|S|}t|||j|tjhB} t||| |d } tfd d| Dr$| }|S) Nrz-Line transformer returned an unchanged result)rTrUrcss|] }|jVqdSrW)rq)rZbracketrQrQrRrrz"run_transformer..rrcss|]}|jduVqdSrWrIrrQrQrRrrrc3s|]}t|dVqdS)rN)r)rlnrrQrRr r)rrrrBextendrrrrrwrMriZ invisiblerrrrrrbclonerrall) rcrrTrUrrZtransformed_lineZ features_setZ line_copyZ features_fopZsecond_opinionrQrrRrsH      r)rQ)rQrQ)rQ)rQrQ)F)yrPr?Z dataclassesrenumrr functoolsrrtypingrrr r r r r Zblack.bracketsrrrrZblack.commentsrrrZ black.linesrrrrrrrZ black.moderrrZ black.nodesrr r!r"r#r$r%r&r'r(r)r*r+r,r-r.r/r0r1r2r3r4r5r6r7r8r9r:r;Zblack.numericsr<Z black.stringsr=r>r?r@rAZ black.transrBrCrDrErFrGrHZblib2to3.pgen2rIZblib2to3.pytreerJrKrZLeafIDrrLrSrrrrr r boolrrrr.r0r3rrrnrrrQrrKrOrr'rrrQrQrQrRs $$ | $    u  2  4 M J  S " V&  +- BR