hz^SSKrSSKrSSKrSSKrSSKrSSKrSSKJrJrJ r J r J r J r J r SSKJrJr SSKJr \R&"\5rSrSSjrSSjrSr/S QrS /S S /S S /S .r"S S5rSSjrSSjrg)N)AttributeProto GraphProto ModelProto NodeProto TensorProtohelper numpy_helper) infer_shapesinfer_shapes_path)versionc UVs/sH9n[[URS55SSRS5S5PM; sn$s snf)zl Convert numpy float16 to python int. :param np_list: numpy float16 list :return int_list: python int list HN)intbinviewzfill)np_list_s Z/var/www/fran/franai/venv/lib/python3.13/site-packages/onnxruntime/transformers/float16.py_npfloat16_to_intrsC=D DGqCAFF3K $**2. 2G DD DsAAc bSnU[R"US:5RSS:aU[R"US:5R5nU[R"US:5R 5nXB:a[ R SUSU35 XQ::a[ R SUSU35 U[R"US:5RSS:aU[R"US:5R5nU[R"US:5R 5nXr*::a[ R SUSU*35 Xa*:a[ R SUSU*35 [R"U"SX5X5n[R"U"U*US5U*U5n[R"U"X [S55X 5n[R"U"[S5X*5U*U5n[R"U5$)a+ Convert float32 numpy array to float16 without changing sign or finiteness. Positive values less than min_positive_val are mapped to min_positive_val. Positive finite values greater than max_finite_val are mapped to max_finite_val. Similar for negative values. NaN, 0, inf, and -inf are unchanged. c8[R"X:X:5$N)np logical_and)abcs rbetween&convert_np_to_float16..between/s~~aeQU++rzthe float32 number z will be truncated to infz-inf) rwhereshapemaxminloggerdebugfloatfloat16)np_arraymin_positive_valmax_finite_valr! positive_max positive_min negative_max negative_mins rconvert_np_to_float16r4's,A&'--a014A 67;;= A 67;;=  ) LL.|n@P[Hxx!1 18Q?BRART\]Hxx%,GbHxxf xIN?\deH ::h r#c,[U[5(d[S[U535eUR[R :Xa[R UlUR(aR[[R"UR5X5n[U5nX@RSS&/URSS&UR(a@[R"URSS9n[XQU5nUR5Ul U$)aaConvert tensor float to float16. Args: tensor (TensorProto): the tensor to convert. min_positive_val (float, optional): minimal positive value. Defaults to 1e-7. max_finite_val (float, optional): maximal finite value. Defaults to 1e4. Raises: ValueError: input type is not TensorProto. Returns: TensorProto: the converted tensor. 3Expected input type is an ONNX TensorProto but got Nfloat32dtype) isinstancer ValueErrortype data_typeFLOATFLOAT16 float_datar4rarrayr int32_dataraw_data frombuffertobytes)tensorr.r/ float16_dataint_list float32_list float16_lists rconvert_tensor_float_to_float16rKIs fk * *NtTZ|n]^^ ;,,,&..   0&:K:K1LN^oL(6H#+  a #%F  a ??== JL0Q_`L*224FO Mr#c[R"U5Rn[R"UR UR U5$r)r to_arrayr&rmake_tensor_value_infonamer=)rFr&s rmake_value_info_from_tensorrPns7  ! !& ) / /E  ( (f6F6F NNr#)ArrayFeatureExtractor BinarizerCastMapCategoryMapperDictVectorizerFeatureVectorizerImputer LabelEncoderLinearClassifierLinearRegressor Normalizer OneHotEncoderRandomUniformLike SVMClassifier SVMRegressorScalerTreeEnsembleClassifierTreeEnsembleRegressor TreeEnsembleZipMapNonMaxSuppressionTopKRoiAlignRangeCumSumMinMaxUpsampler)Resize GroupNorm SkipGroupNormc4\rSrSrSrS\4SjrS\4SjrSr g) InitializerTrackerz'Class for keeping track of initializer. initializerc,Xl/Ul/Ulgr)rt fp32_nodes fp16_nodes)selfrts r__init__InitializerTracker.__init__s&r#nodecU(aURRU5 gURRU5 gr)rvappendrw)rxr{is_node_blockeds radd_nodeInitializerTracker.add_nodes)  OO " "4 ( OO " "4 (r#)rwrvrtN) __name__ __module__ __qualname____firstlineno____doc__rryrr__static_attributes__r#rrrrrs1K )Y)r#rrc &"US:dS5eU[[R"[R5R5::dS5eUc0OUn [ U[ 5(aUn [R"[R5[R"S5:aqU(dj[R"[RRU 5S9n U R n [#X5 [R$"U 5nSnSSS5 O[R$"U 5n[ U[&5(d[)S[+U535eSnU(dD[R"[R5[R"S 5:a[,nUc[.nUc/n[1U5n[1U5n[2R5S US US US USUSUSU35 /n/n/n/nUbU"U5nUR7U5 0n[15n[15nUR8R:Vs/sHCnUR*R<R>[@RB:XdM7UR PME nnUR8RDVs/sHCnUR*R<R>[@RB:XdM7UR PME nn[ U[F5(a5UVs/sH nUU;dM UPM nnUVs/sH nUU;dM UPM nnO U(d/n/n[IUR8R:5GH>unnUR U;dMS[ U5-nUUUR 'URKUR 5 S[ U5-nUR8RLRK5nUROU5 UUl[@RPUR*R<l[RRT"SUR /U/[@RPUS9/nUR8RVRYU5 UR7U5 URKU5 GMA [IUR8RD5GH0unnUR U;dMS[ U5-nUUUR 'URKUR 5 S[ U5-nUR8RLRK5nUROU5 UUl[@RPUR*R<l[RRT"SU/UR /SUS9/nUR8RVRYU5 UR7U5 URKU5 GM3 0nU(Ga,/n UGHn![ U![&5(aU R7U!R85 [ U![Z5(GaU!R\HMnUR^[@RB:XdM#UR U;de[aU5UUR 'MO U!RVGH nUR U;aM[c[eUR:55H7nUR:UU;dMUUR:UUR:U'M9 [c[eURD55H7nURDUU;dMUURDUURDU'M9 URfU;=(d UR U;n"[IUR:5HuunnUU;dMU"=(dI U[hRkURf/5;=(a UU RkURf/5;n#UURmUU#5 Mw U"(aUR7U5 GMURfS:XaZURnHJn$U$R S:XdMU$Rp[@RB:XdM5[@RPU$l8 O URfS;aSn%URnHLn$U$R S:XdMSn%U$Rp[@RB:XdM7[@RPU$l8MN URfS;aFU%(d?URnRY[RRr"S[@RP5/5 URf[h;dURfU ;a'URnHn$U R7U$5 M GMUR7U5 GM# [ U![t5(aU R7U!Rv5 U!RxHnU R7U5 M U!RzRO[}U!RzX55 U!R~Hn[}UX5nM [ U![Z5(dGM[R"U!R:U!RDU!RL5GHJnUR*R<R>[@RB:XaJUR U;a:[@RPUR*R<lUR7U5 UR*RS5(dMUR*RR>R<R>[@RB:XdMUR U;dM[@RPUR*RR>R<lUR7U5 GMM GM U nU(aGM,UR5Hn&U(dU&R(dM[}U&R\X5U&l.UR7[U&R\55 U&R(dMoU(aMx[2RSU&R35 M UGHfn'[IU'R:5GHHunnU[hU'Rf;d UU RkU'Rf/5;aM@UGHn(UU(R :XdMUR8RLRK5nUROU(5 U'R S-[ U5-nUUl[@RBUR*R<lU'R S -[ U5-nRT"SU/U/SUS9/nUR8RVRYU5 UU'R:U' GMF GMK GMi U (a[@RO[@RBn)UGHbn'[c[eU'R:55GH nU'R:UnUHn(UU(R :XdMUR8RLRK5nUROU(5 U'R S-[ U5-nUUlU)UR*R<lU'R S -[ U5-nRT"SU/U/U)US9/nUR8RVRYU5 UU'R:U' GM GM [c[eU'RD55GH nU'RDUn*UHn(U*U(R :XdMUR8RLRK5nUROU(5 U'R S!-[ U5-nUUlU)UR*R<lU'R S"-[ U5-nRT"SU/U*/S#US9/nUR8RVRYU5 UU'RDU' GM GM GMe U$!,(df  GN=f!f=fs snfs snfs snfs snf)$aSConvert tensor float type in the input ONNX model to tensor float16. Args: model (ModelProto or str): The ONNX model or path of the model to convert. min_positive_val (float, optional): minimal positive value. Defaults to 5.96e-08. max_finite_val (float, optional): maximal finite value of float16. Defaults to 65504. keep_io_types (Union[bool, List[str]], optional): It could be boolean or a list of float32 input/output names. If True, model inputs/outputs should be left as float32. Defaults to False. disable_shape_infer (bool, optional): Skips running onnx shape/type inference. Useful if shape inference has been done. Defaults to False. op_block_list (List[str], optional): List of op types to leave as float32. Defaults to None, which will use `float16.DEFAULT_OP_BLOCK_LIST`. node_block_list (List[str], optional): List of node names to leave as float32. Defaults to None. force_fp16_initializers(bool): force converting all float initializers to float16. Default to false, which will convert only the one needed to avoid precision loss. force_fp16_inputs(Dict[str, List[int]]): Force the conversion of the inputs of some operators to float16, even if this script's preference it to keep them in float32. Raises: ValueError: input type is not ModelProto. Returns: ModelProto: converted model. "\o>zginvalid min_positive_val. smallest positive float16 value: subnormal 5.96e-08, and normalized 6.104e-05z4invalid max_finite_val. largest float16 value: 65504Nz1.8.0)dirTz$Expected an ONNX ModelProto but got z1.2.0z"fp16 parameters: min_positive_val=z max_finite_val=z keep_io_types=z disable_shape_infer=z op_block_list=z node_block_list=z force_fp16_initializers=graph_input_cast_graph_input_castCast)torOgraph_output_cast_graph_output_castrmr)EyeLike Multinomial RandomNormalRandomNormalLike RandomUniformr] SequenceEmpty BernoulliFr9)rrr sequence_typezXinitializer is used by both fp32 and fp16 nodes. Consider add these nodes to block list: _input_cast_ _input_cast _output_cast_ _output_cast )Jr+rfinfor,r'r:strr parseonnx __version__tempfileNamedTemporaryFileospathdirnamerOr loadrr;r<r DEFAULT_OP_BLOCK_LISTsetr)r*r}graphinput tensor_type elem_typerr>outputlist enumerateadd value_infoCopyFromr?r make_noder{extendrrtr=rrrangelenop_typeALWAYS_FLOAT_INPUTSgetr attributeimake_attributerggraphstrKtensors itertoolschainHasFieldrvaluesrwrPrvinfoBFLOAT16)+modelr.r/ keep_io_typesdisable_shape_infer op_block_listnode_block_listforce_fp16_initializersforce_fp16_inputs#use_bfloat16_as_blocked_nodes_dtypeforce_fp16_inputs_dict model_pathtmpfileshape_infer_model_pathfunc_infer_shapequeuevalue_info_list node_listmixed_float_type_node_list name_mappinggraph_io_to_skipio_castsn fp32_inputs fp32_outputsr output_name node_namenew_value_infonew_node input_namefp32_initializers next_levelqr~use_fp32_weightattr has_dtypevaluer{r accuracy_typers+ rconvert_float_to_float16rs H x 'q ' U288BJJ#7#;#;< <t>tt <#4#>N~N^^mn{m|}RSfRggvwDvEEVWfVgg@AX@Y Z EOI "$# ' LLLuuH#(;;#4#4j#4a8J8J8T8TXcXiXi8i6166#4Kj$)KK$6$6l$6q!&&:L:L:V:VZeZkZk:kFAFF$6Ll-&&"-D+Qm1Cq+ D#/F 2 LL #-"%++,,-1 66\ !-A6J#-L   (+c!f4I"[[33779N  # #A &",N 8C8K8KN   + + 5((*xAT]^_H KK   # #H -  " "> 2 LL #."8:  A!Z((!!!''*!Z((A{{k&7&77 vv->>>>4Fq4I)!&&1' Avv) "3qww<0771:5)5aggaj)AAGGAJ1#3qxx=188A;,6*6qxx{*CAHHQK2'(ii=&@&]AFFoD]O)2177); :%)::.=/ !%8%<% > J J T / 6 6q 9Jk@E %H#))+ "e&6&6&6 ?@Q@QSc tE   " "#>u?P?P#Q R(?(? notoooAB ,+&tzz2MAz+DLL99QBXB\B\]a]i]ikmBn=n- 0%*[[%;%;%?%?%AN"++J7"&))n"r@rrArCrD RuntimeErrorr4amaxabsr7)rFr.r/ float32_datarGs rfloat_to_float16_max_diffrs fk * *NtTZ|n]^^ ;,,,>??L xx 1 12  }}V__IF 677(XL 77266,L)AAB CCr#)r@) rrFFNNFNF)rloggingrrnumpyrrrrrrrrr onnx.shape_inferencer r packagingr getLoggerrr)rr4rKrPrrrrrrrr#rrs  eee@   8 $E D"JO D#$Aq6QPQFS ) )"!(-yx Dr#