ThB6#<%SSKrSSKrSSKJrJr SSKrSSKJr \R"S\S9r0r \ \RR\4\ S'\"1Sk5rS\S \S \\/\44S jr\"S S 5S3SSSS.S\R&S\R&S\R&S\\R&S\S\S\S \R&4Sjjj5rS\\S\S \4SjrS\R&S\S\S \R&4SjrS\R&S\R&S \S!\S\\S"\S \R&4S#jrS \S!\S S4S$jrS\R&S\R&S \S!\S\\S \R&4 S%jr\"S&S 5S4SSSSSS'SS(.S\R&S\R&S)\R&S*\\R&S+\\R&S,\\R&S-\S.\S/\S"\S\\S0\S1\\S \\R&\R&\R&\R&44S2jjj5rg)5N)CallableOptional)_dtype_mappings_T)boundONNX_ATEN_DECOMP_TABLE> op_type opset_versionreturnc4^^S[S[4UU4SjjnU$)zDDecorator to register an ONNX operator with a custom implementation.funcrc>ST3n[RRSTSU3SS9"U5nU[[ [ [R R T5U5'URU5 U$)Nopsetzonnx::.) mutates_args)torchlibrary custom_oprgetattropsonnx register_fake)roverloadtorch_opr rs N/var/www/fran/franai/venv/lib/python3.13/site-packages/torch/onnx/ops/_impl.py decorator_onnx_op..decorators|=/*==**WIQxj )+   wwuyy~~w'GRS t$)r)r rr!s`` r _onnx_opr$s#  r   r#RotaryEmbeddingF) interleaved num_headsrotary_embedding_dimx cos_cache sin_cache position_idsr'r(r)c^TRSnTRSn[TR5S:XaLTRSn [R"US:gU4Sj5 X-n XxXZ/n [R"TU 5m[R"[TR5S:HS5 TRSn US:XaU nTSS2SS2SS2SU24n TSS2SS2SS2US24n US-nUb UUnUUnOUnUnUSS2SS2SU24nUSS2SS2SU24n[R "US5n[R "US5nU(a%U SS2SS2SS2SSS24nU SS2SS2SS2SSS24nO[R "U SS S 9unnUU-UU-- nUU-UU--nU(ag[R "US 5n[R "US 5n[R"UU4S S 9n[R"UU R5n O[R"UU4S S 9n [R"X4S S 9n[TR5S:Xa![R"UTR5nU$) z_RotaryEmbedding-23 https://onnx.ai/onnx/operators/onnx__RotaryEmbedding.html#rotaryembedding-23rr c">STR3$)NzKnum_heads must be provided for 3D inputs. Received input tensor with shape )shape)r*sr %rotary_embedding_23..>sabcbibiajkr#cg)Nzx should be a 4D tensor by nowrrr#r r3r4Cs,Lr#Ndim)r2lenr_checkreshape unsqueezechunkcat)r*r+r,r-r'r(r) batch_sizesequence_length hidden_size head_size new_shapex_rotate x_not_rotaterotary_embedding_dim_halfcossinx1x2realimagx_rotate_concatoutputs` r rotary_embedding_23rP+sJggajO 177|qggaj  N k  , )G MM!Y ' LLQWW"$LM Iq (Aq////0HQ12334L 4 9      1(((( C  1(((( C // Q C // Q C  aAqt!tm $ aAqt!tm $Xqb1B 8cBh D 8cBh DtR(tR())T4Lb9==(..A99dD\r2 YY/R 8F 177|qvqww/ Mr#scalerCc>UbU$S[R"U5- $)z/Get the scale factor for attention computation.g?)mathsqrt)rQrCs r _get_scale_factorrUs %5GC$))I2F,FGr#tensorr@cURSURSpCXB-nURXX%5RSS5R5$)z1Reshape 3D tensor to 4D for multi-head attention.r r0)r2view transpose contiguous)rVr@r(rArBrCs r _reshape_3d_to_4dr[sH$*<<?FLLO[(I JF 1a r#QKcurrent_q_num_headscurrent_kv_num_headsqk_matmul_output_modec US:Xa [XX#U5$[R"[R"XR SS555$)z1Get QK output tensor based on the specified mode.rr7)_compute_qk_output_for_mode_0r zeros_likematmulrY)r\r]r^r_rQr`s r _get_qk_output_for_aten_spdarfsH!, %U   Q B0C DEEr#cL^^[R"TT-S:HUU4Sj5 g)z-Validate Group Query Attention configuration.rc>STSTS3$)Nz q_num_heads (z%) must be divisible by kv_num_heads (z ) for GQAr)r_r^sr r3-_validate_gqa_configuration..s- 344YZnYooxyr#N)rr;)r^r_s``r _validate_gqa_configurationrjs" LL22a7yr#cUnX#:waX#-nURUSS9n[X@RS5n[R"U5nX-n XX-n [ R "XRSS55$)zDHelper function to compute QK output for qk_matmul_output_mode == 0.r r8r/rbr7)repeat_interleaverUr2rSrTrrerY) r\r]r^r_rQK_for_qk repeat_factor scale_factor sqrt_scaleQ_scaledK_scaleds r rcrcswH2+C &&}!&<$UGGAJ7L<(J~H$H <<"4"4R"< ==r# Attention) is_causal kv_num_heads q_num_headsr`rQsoftcapsoftmax_precisionV attn_maskpast_key past_valuerurvrwrxryc H Supn[UR5nURSn[UR5S:Xa][R"US:g=(a US:gS5 URSn[ UUU5n[ UUU5n[ UUU5n[R"[UR5S:H=(a7 [UR5S:H=(a [UR5S:HS5 URUn[ U U5n Ub[R "XA/US 9OUR5nUb[R "XR/US 9OUR5nUUp!URU nURU nURUnURUnU S :H=(a? U S:H=(a3 U SL=(a( USL=(d UR[R:Hn[UU5 U(atSnUb#UR[R:XaU)OUn[RRRUUUUS UU [UU:g5S 9n[UUUUU U 5nGO]UU:wa%UU-nURUU S 9nURUU S 9n[R "UUURUR"S 9nU(ay[R"USLS 5 [R$"[R&"UU[RUR"S 95nUR)U)[+S55nUb@UR[R:XaUR)U)[+S55nOUU-n[ XRS5n [,R."U 5n!UU!-n"UU!-n#[R0"U"U#R3SS55n$U$nU$U-n%U S:XaU%nU S :aU [R4"U%U - 5-n%U S:XaU%nU buU [6;aUU%Rn&U%R9[:R<U 5n%[R>"U%SS 9n'U'R9U&5n'O+[R>"U%SS 9n'O[R>"U%SS 9n'U S:XaU'n[R0"U'U5nUS:Xa1UR3SS5RA5RCUUS5nUUUU4$)zMAttention-23 https://onnx.ai/onnx/operators/onnx__Attention.html#attention-23)r r0r/rr/cg)Nz;q_num_heads and kv_num_heads must be provided for 3D inputsrrr#r r3attention_23..sQr#r r5cg)Nz'Q, K, and V should be 4D tensors by nowrrr#r r3rs9r#Nr8rt)r{ dropout_prurQ enable_gqa)dtypedevicecg)Nz'Cannot use both is_causal and attn_maskrrr#r r3r@s+Tr#z-infrbr7r0)"r:r2rr;r[rUr?clonerboolrjnn functionalscaled_dot_product_attentionrfrlzerosrtrilones masked_fillfloatrSrTrerYtanh-_ATTENTION_23_ALLOWED_INTERMEDIATE_PRECISIONStorONNX_DTYPE_TO_TORCH_DTYPEsoftmaxrZrX)(r\r]rzr{r|r}rurvrwr`rQrxry num_head_dim sequence_dimhead_diminput_shape_lenr@q_sequence_length q_head_size present_key present_valuer^r_kv_sequence_length can_use_sdpasdpa_attn_maskrO qk_outputrn attn_bias causal_maskrorprqrrqk_matmul_output qk_with_biasoriginal_dtype qk_softmaxs( r attention_23rs&,3(L!''lOJ 177|q 1  2!2 Q GGAJ a[ 9 a\ : a\ : LL AGG Ec!''la/ECLA4E9 ''(#K e[ 1E    8-\2 WWY  !  :/|4 WWY  q'',/77<0 -. 3 A !Q & A  % A$  ?)//UZZ"?  35IJ  +4??ejj+HiZiN$$AA $#';;B  1   !   "6 6/3GGM##M|#DA##M|#DAKK 1  LLT!#T  ** %&**88 K"--{lE&MJI  %**,%119*eFmL & 1 ) ; YY|, z>z>!<<(2D2DR2LM% ()3 A %$I S="UZZ w0F%GGL A %$I  ( $QQ!-!3!3+#==>OP  #]]: "]]rs` % * ^^D)ACUZZ22H<=B091-c#(B482D& R ,0 R  !R ||R||R||R5<<( R  RRR \\R!RjHXe_HHH  LL &) 69  \\ F ||F ||FF F E? F  F \\F$47 > ||> ||>> > E? >  \\ >, +r )-'+)- F9!"!'+F9 ||F9 ||F9 ||F9 % F9 u||$ F9 & F9F9F9F9F9 E?F9F9 }F9 5<<u||U\\ ABF9F9r#