h(FSSKJr SSKrSSKJr SSKJr "SS\5rg) ) annotationsN) ONNXModel)Fusionc^\rSrSrSU4SjjrS SjrS SjrS SjrS SjrSr U=r $) FusionGeluc(>[TU]USS5 g)NGeluErf)super__init__)selfmodel __class__s f/var/www/fran/franai/venv/lib/python3.13/site-packages/onnxruntime/quantization/fusions/fusion_gelu.pyrFusionGelu.__init__s .cURXU5(d.URXU5(dURXU5(aURR SS5 gg)zg Interface function that tries to fuse a node sequence containing an Erf node into a single Gelu node. com.microsoftrN)fuse_1fuse_2fuse_3rset_opset_import)rerf_nodeinput_name_to_nodesoutput_name_to_nodes rfuseFusionGelu.fusesT KK7J K K{{8:MNN{{8:MNN JJ ' ' ;OrcURSU;agX!RSn[U5S:wdUSRS:wagUSnURUS5(dgURSU;agX%RSn[U5S:wdUSRS:wagUSnUR USSU5nUcgUR USSS 9S:wagUR SnUR SURS:XaSOSn XR U :XaaX&RSn[U5S:wdUSRS:wagUSn URU S 5(dgU RSn ONUR USX5n U cgURU S 5(dgXR ;agURSn XqXVU /n URX/X#5(dgURRU 5 [RRS UR5U/U /S 9n S U lURR!U 5 g)a This pattern is from PyTorch model Fuse Gelu with Erf into one node: Pattern 1: +-------Mul(0.5)---------------------+ | | | v [root] --> Div -----> Erf --> Add --> Mul --> (B=1.4142...) (1) Pattern 2: +------------------------------------+ | | | v [root] --> Div -----> Erf --> Add --> Mul -->Mul --> (B=1.4142...) (1) (0.5) Note that constant input for Add and Mul could be first or second input: like either A=0.5 or B=0.5 is fine. rFrAddMulDiv -?MbP?delta?r nameinputsoutputsrToutputlenop_typehas_constant_input match_parentfind_constant_inputinputis_safe_to_fuse_nodesnodes_to_removeextendonnxhelper make_nodecreate_unique_node_namedomain nodes_to_addappend)rrrrchildren add_after_erf mul_after_erfdivsubgraph_inputanothermul_halfsubgraph_outputsubgraph_nodes fused_nodes rrFusionGelu.fuse_1#sw2 ??1 %8 8&q'9: x=A !!4!4!=  &&}a88    "*= =&';';A'>? x=A !!4!4!=  %4GH ;  # #Cu # = B1$**1-1E1Ea1HH!a 009 9*+?+?+BCH8}!Xa[%8%8E%A{H**8S99&ooa0O((w\H**8S99^^3+2215OxP)).:KM`vv ##N3[[** 557@P[jZk+ ,    ,rcURSU;agX!RSn[U5S:wdUSRS:wagUSnURUS5(dgURSU;agX%RSn[U5S:wdUSRS:wagUSnURUS5(dgURSU;agX&RSn[U5S:wdUSRS:wagUSnUR USSU5nUcgSn UR US S S 9S:wa0UR US SU5n U cgURU S 5(dgUR Sn XR ;agXXVU/n U (aU RU 5 URXRS/X#5(dgURRU 5 [RRSUR5U /URS/S9n SU lUR RU 5 g)a This pattern is from Keras model Fuse Gelu with Erf into one node: +------------------------------------------+ | | | v [root] --> Div -----> Erf --> Add --> Mul -->Mul (B=1.4142...) (A=1) (A=0.5) Note that constant input for Add and Mul could be first or second input: like either A=0.5 or B=0.5 is fine. rFrr"r#r)r$Nr%r&r'Sqrtg@r r*rT)r/r0r1r2r3r4r5r?r6r7r8r9r:r;r<r=r>) rrrrr@rArBmulrC sqrt_noderDrHrIs rrFusionGelu.fuse_2zsd" ??1 %8 8&q'9: x=A !!4!4!=  &&}a88    "*= =&';';A'>? x=A !!4!4!=  &&}c::    "*= =&';';A'>? x=A !!4!4!=qk%4GH ;  # #Cu # = B))#vq:MNI **9c::1  *sK   ! !) ,)).::a=/K^tt ##N3[[** 557@P[^[e[efg[hZi+ ,    ,rcVURSU;agX!RSn[U5S:wdUSRS:wagUSnURUS5(dgURSU;agX%RSn[U5S:wdUSRS:wagUSnURUS5(dgUR USSU5nUcgUR USSS 9nUS:agSU- n UR U n URSU;agX&RSn[U5S:wdUSRS:wagUSn U R SU :XdU R SU :XdgXqXVU /n URU U RS/UU5(dgURRU 5 [RRS UR5U /U RS/S 9n S U lURR!U 5 g )a This pattern is from TensorFlow model Fuse Gelu with Erf into one node: +----------------------------------------------+ | | | v [root] --> Mul -----> Erf --> Add --> Mul -->Mul (A=0.7071067690849304) (B=1) (B=0.5) Note that constant input for Add and Mul could be first or second input: like either A=0.5 or B=0.5 is fine. rFrr"r#r)g`?r&r'r r*rTr.)rrrrr@rArF first_muliroot_input_indexrDlast_mulrHrIs rrFusionGelu.fuse_3sO$ ??1 %8 8&q'9: x=A !!4!4!=  &&}a88    "*= =&';';A'>? x=A !!4!4!=A;&&x55%%hq:MN    $ $Y0B% $ P q5q5")9: ??1 %8 8&q'9: x=A !!4!4!=A;q!^3x~~a7HN7Z#}Q))  __Q       ##N3[[** 557@P[c[j[jkl[mZn+ ,    ,r)rr)ronnx.NodeProtordict[str, list[onnx.NodeProto]]rdict[str, onnx.NodeProto])rrWrrXrrYreturnbool) __name__ __module__ __qualname____firstlineno__rrrrr__static_attributes__ __classcell__)rs@rr r s/< <=<7 <"U U=U7 U  UnJ J=J7 J  JXJ J=J7 J  JJrr ) __future__rr9 onnx_modelrfusionrr rVrrres! # "BBr