hLSSKrSSKr\R"\5r"SS5rg)Nc\rSrSrSr\SS\4Sjj5r\S5r\S5r \S\ \ \ R4Sj5r \SS \ \ RS \4S jj5r\SS\ \ \ R4S jj5rS rg)PastKeyValuesHelperzEHelper functions to process past key values for encoder-decoder modelpresentc/n/n[U5HWnURU(a SU3SU3/O SU3SU3/5 URU(a SU3SU3/O SU3SU3/5 MY X#-$) Npresent_key_self_present_value_self_past_key_self_past_value_self_present_key_cross_present_value_cross_past_key_cross_past_value_cross_)rangeextend) num_layersrpast_self_namespast_cross_namesis ^/var/www/fran/franai/venv/lib/python3.13/site-packages/onnxruntime/transformers/past_helper.pyget_past_names"PastKeyValuesHelper.get_past_namessz"A  " "%QC(,?s*CD&qc*.>qc,BC   # #&aS)-A!+EF's+/@-DE  #11c/n/n[U5HRup4[U5S:XdS[U535eUunnnnURXV/5 URXx/5 MT X4$)aSplit present state from grouped by layer to grouped by self/cross attention. Before: (past_key_self_0, past_value_self_0, past_key_cross_0, past_value_cross_0), (past_key_self_1, past_value_self_1, past_key_cross_1, past_value_cross_1), ... After: (past_key_self_0, past_value_self_0, past_key_self_1, past_value_self_1, ...), (past_key_cross_0, past_value_cross_0, past_key_cross_1, past_value_cross_1, ...) !Expected to have four items. Got  enumeratelenr) present_key_values present_self present_cross_ipresent_layer_ipresent_key_selfpresent_value_selfpresent_key_crosspresent_value_crosss rgroup_by_self_or_cross*PastKeyValuesHelper.group_by_self_or_cross"s  #,-?#@ B'1, h0QRUVeRfQg.h h,    "!#   !1 F G  "3!I J$A**rcl^^[T5ST-:Xde[UU4Sj[T555$)aReorder past state from grouped by self/cross attention to grouped by layer. Before: past_key_self_0, past_value_self_0, past_key_self_1, past_value_self_1, ..., past_key_cross_0, past_value_cross_0, past_key_cross_1, past_value_cross_1, ... After: (past_key_self_0, past_value_self_0, past_key_cross_0, past_value_cross_0), (past_key_self_1, past_value_self_1, past_key_cross_1, past_value_cross_1), rc3># UH5nTSU-TSU-S-TST-SU--TST-SU--S-/v M7 g7f)N).0rrpasts r 5PastKeyValuesHelper.group_by_layer..>sg ' QU QUQYQ^a!e+,Q^a!e+a/0   's=A)rtupler)r1rs``rgroup_by_layer"PastKeyValuesHelper.group_by_layer7s< 4yA N*** :&   rpast_key_valuescSn[U5S-n[[U5S-5H&nSU-nUXXS-XU-XU-S-44- nM( U$)aCategorize present_key_values from self and cross attention to layer by layer. Reorder past state from grouped by self/cross attention to grouped by layer. Before: past_key_self_0, past_value_self_0, past_key_self_1, past_value_self_1, ..., past_key_cross_0, past_value_cross_0, past_key_cross_1, past_value_cross_1, ... After: (past_key_self_0, past_value_self_0, past_key_cross_0, past_value_cross_0), (past_key_self_1, past_value_self_1, past_key_cross_1, past_value_cross_1), Args: present_key_values: From past_key_values of a model (group by self and cross attention) Returns: past_tuples: present key and values grouped by layer. r/r-rr.)rr)r7 past_tupleshalf_idxridxs rback_group_by_layer'PastKeyValuesHelper.back_group_by_layerHs  '1,s?+q01Aa%C #(#!G,#sN3#sNQ$67  K2rr concatc/n/n[U5HPupE[U5S:XdS[U535eUupgpURXg/5 URX/5 MR U(aX#-$X#4$)a8Categorize present_key_values into self and cross attention. Split present state from grouped by layer to grouped by self/cross attention. Before: (past_key_self_0, past_value_self_0, past_key_cross_0, past_value_cross_0), (past_key_self_1, past_value_self_1, past_key_cross_1, past_value_cross_1), ... After: (past_key_self_0, past_value_self_0, past_key_self_1, past_value_self_1, ...), (past_key_cross_0, past_value_cross_0, past_key_cross_1, past_value_cross_1, ...) Args: present_key_values: From past_key_values of a model (group by layer) concat: If concat self attention with cross attention key/value to return Returns: present_self (Tuple[torch.Tensor]): present key and values from self attention present_cross (Tuple[torch.Tensor]): present key and values from cross attention rrr) r r>r!r"_r$r%r&r'r(s rgroup_by_self_and_cross+PastKeyValuesHelper.group_by_self_and_crossfs$,. ,. "+,>"? A'1, h0QRUVeRfQg.h h,[j X 2C   !1 F G  "3!I J #@ / /. .rcl/nU(a[U5S-O [U5nU(dSOSn[U5H/nURSU3SU34Vs/sHodU-PM sn5 M1 [U5H/nURSU3SU34Vs/sHodU-PM sn5 M1 U$s snfs snf)zProcess input names of model wrapper. Args: past_key_values: Consider `self` and `cross` past_key_values Returns: names (List[string]): input names rpast_present_ key_self_ value_self_ key_cross_ value_cross_)rrr)r7encodernamesrprefixrss rget_input_names#PastKeyValuesHelper.get_input_namess29S)Q.s??S 'Zz"A LL1#+aS@Q.RS.R1*.RS T#z"A LLA3/?r]s)   8 $GGr