U qhn@sddlmZddlZddlmZmZddlZddlm Z ddl m Z m Z mZmZmZmZddlmZmZdddd d ZdZd d d dddZdddddddZejeddgdZd[d d ddd dddZddddddd ZejeddgdZd\d d ddd dd!d"Zd#d$dd d%d&d'Zd]d)d*d d+d,d-Zd^d)d*d d+d.d/Z d_d d0d)d1d2d3Z!d`d d0d)d4d5d6Z"d7d8d9d:d;Z#dad8d0dd?Z$d@dAdBdCdDZ%dbdAd0d@dEdFdGZ&dHdIdJdKdLZ'dcdId0dsz,combine_pairs_to_complex..r)rangelenrrrrcombine_pairs_to_complexsrz np.int16 | np.int32 | np.ndarrayzint | Sequence[int] | Nonez np.ndarray)datadimsrcCsxdd}|dkrZt|jdkrB|t|gtjtjdS||tjtjS||tj|tjS)a_Converts ndarray of bf16 (as uint32) to f32 (as uint32). Args: data: A numpy array, empty dimensions are allowed if dims is None. dims: If specified, the function reshapes the results. Returns: A numpy array of float32 with the same dimension if dims is None, or reshaped to dims if specified cSs|d>S)Nrxrrr#z%bfloat16_to_float32..Nr) rshapenparrayastypeint32viewfloat32reshape)rrshiftrrrbfloat16_to_float32s $r+intboolz np.float32)ivalfnuzrc Cs\|s td|dks|dkr*t|d|rBd}|dkrptjSn.d}|dkr\ttj S|dkrpttjSt|}|d @d ?}|d@}|d@}|d >}|dkr"|dkrFd|}|d @dkr|d M}|d K}|d 8}|d @dkr|d M}|d K}|d 8}||d @d>O}||d>O}n$||d>O}|d|7}||d>O}t|tj}|S)Nzfn=False is not implemented.rz is not a float8.xr)NotImplementedError ValueErrorr#nanr(uint32r' r.r/r0Z exponent_biasZexpoZmantsignresfrrr_float8e4m3_to_float32_scalar+sH         rEr/r0)ZexcludedTF)rrr/r0rcCs0|s tdt|||d}|dkr&|S||S)aConverts ndarray of float8, e4m3 (as uint32) to f32 (as uint32). See :ref:`onnx-detail-float8` for technical details. Args: data: A numpy array, empty dimensions are allowed if dims is None. dims: If specified, the function reshapes the results. fn: No infinite values. uz: No negative zero. Returns: A numpy array of float32 with the same dimension if dims is None, or reshaped to dims if specified. z4float32_to_float8e4m3 not implemented with fn=False.r/r0N)r=_float8e4m3_to_float32r)rrr/r0rCrrrfloat8e4m3_to_float32ZsrIc CsR|r"|r"|dkrttjSd}nj|s|s|dkr@ttj S|dkrTttjS|dkrjttj S|dkr~ttjSd}ntdt|}|d@d ?}|d @}|d@}|d >}|d kr|d krO}||d>O}n$||d>O}|d |7}||d>O}t|tj}|S)Nr3r>r1>}~r5|z%fn and uz must be both False or True.rr7r8rr5rr;r:)r#r(r?infr=r@r'rArrr_float8e5m2_to_float32_scalarxsD           rScCs$t|||d}|dkr|S||S)aConverts ndarray of float8, e5m2 (as uint32) to f32 (as uint32). See :ref:`onnx-detail-float8` for technical details. Args: data: A numpy array, empty dimensions are allowed if dims is None. dims: If specified, the function reshapes the results. fn: No infinite values. uz: No negative zero. Returns: A numpy array of float32 with the same dimension if dims is None, or reshaped to dims if specified rFN)_float8e5m2_to_float32r)rHrrrfloat8e5m2_to_float32srUznp.int32 | np.ndarrayzint | Sequence[int])rrsignedrcsfdd}t|dd}||\}}tj|j|jftjd}||ddd<||ddd<|jt|dkr|dd}||}|S) aConverts ndarray of int4 (as packed uint8) to f32 See :ref:`onnx-detail-int4` for technical details. Args: data: A numpy array, empty dimensions are allowed if dims is None. dims: The dimensions are used to reshape the unpacked buffer signed: Whether the 4 bit integer is signed or unsigned Returns: A numpy array of float32 reshaped to dims. cs t|SN)r Zunpack_single_4bitx2rrVrrr r!zunpack_int4..rrdtyperN)r#Z frompyfuncravelemptysizer(prodr))rrrVZ single_funcfuncZres_highZres_lowrCrrXr unpack_int4s  rarstr)tensorbase_dirrc Cs|drtd|jtjkr&td|j}t|}tt|}t |}|j }|jtj krt ||}dd|D}t |||St|rt|||dr|j} tjdkrt j| |d} |tjkrt j| t jd} t| |S|tjkrt j| t jd} t| |S|tjkrHt j| t jd} t| |d d S|tj krnt j| t jd} t!| |S|tj"krt j| t jd} t!| |d d d S|tj#krt j| t j$d} t%| |d d S|tj&krt j| t jd} t%| |d d St j| |d|S|tj'kr.t j|j(t j)d|*t j+S|tjkrVt j|j(t j,d} t| |S|tjkr~t j|j(t j,d} t| |S|tjkrt j|j(t j,d} t| |d d S|tj krt j|j(t j,d} t!| |S|tj"krt j|j(t j,d} t!| |d d d S|tj#kr*t j|j(|d} t%| |d d S|tj&krTt j|j(|d} t%| |d d St ||} |tj-tj.fkrxt/| } t j| |d||S)zConverts a tensor def object to a numpy array. Args: tensor: a TensorProto object. base_dir: if external tensor exists, base_dir can help to find the path to it Returns: arr: the converted array. segmentz*Currently not supporting loading segments.z4The element type in the input tensor is not defined.cSsg|]}|dqS)utf-8)decode)rsrrrrsz_to_array..raw_databigrYT)r0rFFrX)0HasFieldr> data_typer UNDEFINED TypeErrorr tensor_dtype_to_np_dtypeZ$tensor_dtype_to_storage_tensor_dtypeZtensor_dtype_to_fieldrSTRINGgetattrr#Zasarrayr%r)r r rjsys byteorder frombufferbyteswaptobytesBFLOAT16int16r+ FLOAT8E4M3FNint8rIFLOAT8E4M3FNUZ FLOAT8E5M2rUFLOAT8E5M2FNUZUINT4uint8raINT4ZFLOAT16 int32_datauint16r'Zfloat16r&Z COMPLEX64Z COMPLEX128r) rdre tensor_dtypenp_dtypeZstorage_np_dtypeZ storage_fieldrZ utf8_stringsssrjrrrr _to_arrays                               rc Cs|j}|tjkrjt|r"t|||j}t|j}tj |t j d }t |D]\}}|||<qN||S|tjtjtjtjfkrtjt jtjt jtjt jtjt ji}t|rt|||dr|j}n|j}t|j}tj |||d }t |D]\}}|||<q||S|tjtjfkrt|r}t}|j|j|r||_ |!|_"||_#|St|||}||_#|S)a Converts an array into a TensorProto including supported type defined in :mod:`onnx._custom_element_types`. Args: tensor: a numpy array. name: (optional) the name of the tensor. Returns: TensorProto: the converted tensor def. rZe4m3fnZe4m3fnuzZe5m2Ze5m2fnuzrrrrrzIThe conversion of a tensor of INT4 or UINT4 requires an even size (shape=z+). Every byte stores two INT4 or two UINT4.NrPr9)$rr#rrrZrrdescrrrzrrr|rr}rr~rrxrrrr{rrr%r\r^r>r"rrrrwrjrm) rdrdttoZdt_tovaluebufferZpbtrrr from_arraysT       $ rrz list[Any])sequencercCsz|j}|tjkr dd|jDS|tjkr:dd|jDS|tjkrTdd|jDS|tjkrndd|j DSt ddS)zConverts a sequence def to a Python list. Args: sequence: a SequenceProto object. Returns: list: the converted list. cSsg|] }t|qSrrrvrrrr#szto_list..cSsg|] }t|qSrrrrrrr%scSsg|] }t|qSr)to_listrrrrr'scSsg|] }t|qSr)to_dictrrrrr)sz8The element type in the input sequence is not supported.N) rrTENSOR tensor_values SPARSE_TENSORZsparse_tensor_valuesSEQUENCEsequence_valuesMAP map_valuesro)rrrrrrs     rz int | None)lstrrZrc st}|r||_|r|}nFtdkrZd}t|tr@tj}q`t|trRtj}q`tj}ntj}||_ tdkrt fddDst d|tjkrD]}|j t|gqnZ|tjkrD]}|j t|gqn2|tjkr D]}|j t|gqnt d|S)a]Converts a list into a sequence def. Args: lst: a Python list name: (optional) the name of the sequence. dtype: (optional) type of element in the input list, used for specifying sequence values when converting an empty list. Returns: SequenceProto: the converted sequence def. rc3s |]}t|tdVqdS)rN)rr)relemrrr Oszfrom_list..zqThe element type in the input list is not the same for all elements and therefore is not supported as a sequence.zZThe element type in the input list is not a tensor, sequence, or map and is not supported.)rrrrdictrlistrrrallrorrrr from_listr from_dict) rrrZrrZ first_elemrdseqmappingrrrr-s>   "   rrzdict[Any, Any]) map_protorcCs`g}|jtjkrt|j}n t|j}t|j}t|t|krNt d|j dt t ||}|S)zConverts a map def to a Python dictionary. Args: map_proto: a MapProto object. Returns: The converted dictionary. z2Length of keys and values for MapProto (map name: z) are not the same.) key_typerrqr string_keyskeysrvaluesr IndexErrorrrzip)rZkey_listZ value_list dictionaryrrrrfs     r)dict_rrcst}|r||_t|}t|dt}tjtj tj tj tj tj tjtjg}tfdd|Dsrtdt|}t|dtfdd|Dstdt|}||_|tjkr|j|n||kr|j||j||S)zConverts a Python dictionary into a map def. Args: dict_: Python dictionary name: (optional) the name of the map. Returns: MapProto: the converted map def. rc3s|]}t|kVqdSrWr# result_type)rkey) raw_key_typerrrszfrom_dict..zfThe key type in the input dictionary is not the same for all keys and therefore is not valid as a map.c3s|]}t|kVqdSrWr)rval)raw_value_typerrrszjThe value type in the input dictionary is not the same for all values and therefore is not valid as a map.)rrrr#rr rrZINT8ZINT16ZINT32ZINT64ZUINT8ZUINT16ZUINT32ZUINT64rrorrrrqrrrCopyFrom)rrrrrZvalid_key_int_typesrZ value_seqr)rrrrsH       rrz Any | None)optionalrcCs|j}|tjkrdS|tjkr(t|jS|tjkrttj}||kr8t|d|}n:t|trPtj}n(t|trbtj }n|dkrrtj }ntj }||_ |dk r|tj kr|j t|n@|tj kr|jt|n$|tjkr|jt|ntd|S)aConverts an optional value into a Optional def. Args: opt: a Python optional name: (optional) the name of the optional. dtype: (optional) type of element in the input, used for specifying optional values when converting empty none. dtype must be a valid OptionalProto.DataType value Returns: optional: the converted optional def. z( must be a valid OptionalProto.DataType.NzUThe element type in the input is not a tensor, sequence, or map and is not supported.)rrrZDataTyperrorrrrrnrrrrrrrrr)rrrZrZ valid_dtypesrrrr from_optionals6     rNone)rdrcCs.|j}t|}tj|j|d|_dS)znCall to convert endianness of raw data in tensor. Args: tensor: TensorProto to be converted. rYN)rmr rpr#rurjrvrw)rdrrrrrrs rrz tuple[int]znp.dtype) input_shaperZseedrc Cstj||tjtjtjtjtjtjtj tj fkrt t |j t tj j }t t |j t tj j }tjj|||d|St|ddS)a'Create random integer array for backend/test/case/node. Args: input_shape: The shape for the returned integer array. dtype: The NumPy data type for the returned integer array. seed: The seed for np.random. Returns: np.ndarray: Random integer array. )r^z' is not supported by create_random_int.N)r#randomrrrr@Zuint64r{ryr&Zint64minZiinfomaxrandintr%ro)rrZrendstartrrrcreate_random_ints  r)N)NTF)NFF)rb)rb)N)N)NN)N)NN)r)+ __future__rrstypingrrZnumpyr#Zonnx._custom_element_typesZ_custom_element_typesrZonnxrrrrr r Zonnx.external_data_helperr r rr+rEZ vectorizerGrIrSrTrUrarrrrrrrrrrrrrrrrsZ   *(!rHA=9:4