uPj}D RUddlmZddlmZddlmZmZmZmZddlm Z ddlm Z ddl m Z ddlmZerddlmZd d d d d d d d ddd Zeed<ehdZeed<dededzfdZdededzfdZdedededzdedzfdZdeeefde dzfdZdededzfd ZGd!d"Zy)#)Mapping)datetime) TYPE_CHECKINGAnyFinalcast)BatchRequestCounts)Metadata)get_aws_dns_suffix LiteLLMBatch)Logging validating in_progress cancelling cancelled completedfailedexpired) Submitted Validating Scheduled InProgressStoppingStopped CompletedPartiallyCompletedFailedExpired_BEDROCK_MIJ_STATUS_TO_OPENAI>rrrrr_CANCEL_IDEMPOTENT_STATUSESarnreturnNc |jd}t|dk\r|ddk(r |dxsdSy#t$rYywxYw)z=ARN shape: ``arn:aws:bedrock:::/``:bedrockN)splitlen Exception)r"partss i/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/bedrock/batches/handler.py _extract_region_from_bedrock_arnr/!sU yy~ u:?uQx948#t #     s /3 ??c>d|vry|jdddxsdS)zR``arn:aws:bedrock:::model-invocation-job/`` -> ````.z:model-invocation-job/N/)rsplit)r"s r._extract_job_id_from_arnr5,s(s* ::c1 b ! )T) output_prefix input_urijob_idc|r|r|sy|jds|dz}|jddd}|sy||d|dS)a Compute the deterministic per-job result file URI Bedrock writes to. Bedrock lays results out as:: //.out We compute it client-side so OpenAI-style ``client.files.content(output_file_id)`` works without an extra S3 ``ListObjectsV2`` round-trip. Returns ``None`` if we don't have enough info; callers should fall back to the bare prefix. Nr1r2r3z.out)endswithr4)r7r8r9input_basenames r._predict_output_file_urir=3s[    ! !# &%+ %,,S!4R8N _VHAn%5T ::r6responsec|jd}|jd}t|trt|tsy|jd}t||t|tr|SdS)NtotalRecordCountsuccessRecordCounterrorRecordCountrtotalrr)get isinstanceintr )r> total_recordssuccess_records error_recordss r._record_counts_from_responserKIsu#<<(:;M%\\*>?O mS )OS1Q#<<(:;M ! *=# >} EF r6valuec|yt|ttfr t|St|trt|j SyN)rFrGfloatr timestamp)rLs r. _to_epochrQVsA }%#u&5z%"5??$%% r6ceZdZdZe ddededzdddedzdedzd edzd edzd edzd edzd edzdedzdedzdeddfdZeddededdfdZe ddededzddfdZ y)BedrockBatchesHandlerz Handler for Bedrock Batches. Specific providers/models needed some special handling. E.g. Twelve Labs Embedding Async Invoke Nbatch_idaws_region_name logging_objzLiteLLMLoggingObj | Noneaws_access_key_idaws_secret_access_keyaws_session_tokenaws_session_nameaws_profile_name aws_role_nameaws_web_identity_tokenaws_sts_endpointaws_external_idkwargsr#r c R  ddl} ddlm}|xst xsdddlm}|j  }| jd|j|j|j}d  f d } |j |S#t$r}td|d}~wwxYw#|$rT}|jjd ijd d vr|}|jt vr|cYd}~Sd}~wwxYw)Nr) ClientErrorz@Missing boto3/botocore to call bedrock. Run 'pip install boto3'. us-east-1BedrockBatchesConfig rWrXrYrUrZr[r\r]r^r_r( region_namerWrXrYcF tj  S)N) rTrUrVrWrXrYrZr[r\r]r^r_)rS#_handle_model_invocation_job_status) rWr_r[r\rXrZrYr^r]rTrVregions r. job_statusz6BedrockBatchesHandler.cancel_batch..job_statuss@(LL! &'"3&;"3!1!1+'=!1 /M  r6 jobIdentifierErrorCode)ValidationExceptionConflictException)r#r )boto3botocore.exceptionsrb ImportErrorr/+litellm.llms.bedrock.batches.transformationreget_credentialsclient access_key secret_keytokenstop_model_invocation_jobr>rEstatusr!)rTrUrVrWrXrYrZr[r\r]r^r_r`rsrbexcrecredsrxrle current_batchrks` `````````` @r. cancel_batchz"BedrockBatchesHandler.cancel_batchis?  k  7(d+KH+UdYdT+-==/"7/"--'#9-+>   #.."'"2"2#kk %      !  , ,8 , D|m k`agj j k\ !zz~~gr*..v6>jj#-._async_get_statuss)'7'9 ,V+<+U+U,' /', ,&O 9#22D"EFZ"[\c"d#2#6#67G#H#NB,Z8A ! )"?3&x0*<8./AB,00;=LX=VZb=b?..y9hl1#28#< #KaQR / 9X E11  /"') !F&MG&s!CB>BCcj}j| |j|jS#|jwxYwrN)new_event_loopset_event_looprun_until_completeclose)new_looprasyncios r. run_in_threadzHBedrockBatchesHandler._handle_async_invoke_status..run_in_threadsK%446H  " "8 , !223D3FG  s A A)r$litellm.llms.bedrock.embed.embeddingrconcurrent.futuresfuturesThreadPoolExecutorsubmitr) rTrUrVr` concurrentrexecutorfuturerrrs ```` @@@r._handle_async_invoke_statusz1BedrockBatchesHandler._handle_async_invoke_statussb I( ( X " !   2 2 4 #$OOM:F==? # # #s !A**A3c N ddl}|xst|xsd}ddlm}|j |j d|j d|j d||j d |j d |j d |j d |j d |j d }|jd||j|j|j} |:t|xs|} |j|dd|id|dt|d| d| j|} ||j|d| dd|iit!| j dd} t#t$t&j | d} | j dij dij d d}| j d!ij d"ij d d}| j d#|}t|}t)|||}t+| j d$}| j d%d|| j d&d| j d'xsd|||xsdd(}t-|d)| t+| j d*xsdt+| j d+| d,k(r|nd| d-k(r|nd| d.k(r|nd| d/k(r|ndt/| |d0d1|| d,k(r|2Sd2S#t$r}td|d}~wwxYw)3u Handle ``GetModelInvocationJob`` status check for AWS Bedrock bulk batch inference jobs (the ARN type returned by ``CreateModelInvocationJob``). ``CreateModelInvocationJob`` lives on the Bedrock **control plane** (``bedrock..amazonaws.com``), distinct from the data-plane ``bedrock-runtime`` endpoint that serves Twelve Labs async-invoke ARNs. The two ARN families therefore can't share a handler — see ``litellm/batches/main.py`` for the dispatch. Args: batch_id: A ``arn:aws:bedrock:::model-invocation-job/`` ARN (or just the trailing job id; both are accepted by ``GetModelInvocationJob``). aws_region_name: Region for the boto3 ``bedrock`` client. If omitted, we fall back to parsing the region out of ``batch_id`` itself. logging_obj: Optional litellm logging object. **kwargs: Optional AWS credential overrides (``aws_access_key_id``, ``aws_secret_access_key``, ``aws_session_token``, ``aws_profile_name``, ``aws_role_name``, ``aws_session_name``, ``aws_web_identity_token``, ``aws_sts_endpoint``, ``aws_external_id``). Unknown keys are ignored. Returns: ``LiteLLMBatch`` shaped like an OpenAI Batch resource. ``request_counts`` maps ``GetModelInvocationJob``'s ``totalRecordCount`` / ``successRecordCount`` / ``errorRecordCount`` when the provider reports them, and is ``None`` when it does not (older botocore, or a status that omits counts). rNz7Missing boto3 to call bedrock. Run 'pip install boto3'.rcrdrWrXrYrZr[r\r]r^r_rfr(rgrrnzhttps://bedrock..z/model-invocation-job/)complete_input_dictapi_base)inputapi_keyadditional_argsrmr)rroriginal_responserr}rinputDataConfigs3InputDataConfigrrrjobArnrmodelIdjobNamemessage)rjob_arnjob_namer input_s3_uri output_s3_urioutput_file_urirrrrrrrrz/v1/chat/completions)rrr}rrrr cancelled_at expired_atrrrrrr)rsrur/rvrerwrErxryrzr{r5pre_callr get_model_invocation_job post_callstrrrr r=rQr rK)rTrUrVr`rsr~rkrerrx url_path_idr>bedrock_status openai_statusr8r7rr9rrrs r.rjz9BedrockBatchesHandler._handle_model_invocation_job_statussmL b  (d+KH+UdYd U+-==$jj)<="(**-D"E$jj)<="#ZZ(:;#ZZ(:; **_5#)::.F#G#ZZ(:;"JJ'89>   #.."'"2"2#kk %   " ":(!C!OxK  ,;X+F*6(!4Fv4N3OOefqers! ! !999Q  "  ! !"*!6(8S T " !$HLL2$> ?#  ) - -nm L $<<(92>BBCVXZ[__`gikl '||,>CGGH\^`aeefmoqr "h909!9-TZ![' Y(?@ "i4 Y3'||I6<"%*.4"=   l!;<A$X\\2D%EF)6+)E4&3x&?lT)6+)E4'4 'A|t7A*#+#.;{.J?  QU  G bWX^a a bsL L$ LL$) NNNNNNNNNNNrN)NN) __name__ __module__ __qualname____doc__ staticmethodrrrrrjrr6r.rSrS`sn'+26(,,0(,'+'+$(-1'+&*HHtH0H: H #Tz H : H*H*HTzH!$d H*HtHH HHTJ#cJ#CJ#hvJ#J#X'+Z Z tZ  Z Z r6rS) collections.abcrrtypingrrrropenai.types.batchr r OpenAIBatchMetadata(litellm.litellm_core_utils.aws_partitionr rr *litellm.litellm_core_utils.litellm_loggingrLiteLLMLoggingObjr __annotations__ frozensetr!rr/r5r=rrKrGrQrSrr6r.rs#221>G,W % (u &//l%mUm##**#*#**;C;C;t;X[^bXb;, 73;+? DVY]D] SS4Z| | r6