uPj< tUddlmZmZddlmZmZmZmZmZddl m Z ddl m Z ddl ddlmZmZddlmZddlmZdd lmZmZmZdd lmZmZmZmZeZeed <ejAd eege d gejAdeege d geefdededefdZ!ejEd eege d gejEdeege d geefdededefdZ#ejEdeege d gejEdeege d geefdede$dedefdZ%ejMdeege d gejMdeege d geefdede$dedefdZ'ddl(m)Z)e)ey))AnyFinal) APIRouterDepends HTTPExceptionRequestResponse)ORJSONResponse)verbose_proxy_logger)*)UserAPIKeyAuthuser_api_key_auth)ProxyBaseLLMRequestProcessing)_read_request_body))get_custom_llm_provider_from_request_body,get_custom_llm_provider_from_request_headers*get_custom_llm_provider_from_request_query) assert_user_can_access_containerfilter_container_list_responseget_container_forwarding_paramsrecord_container_ownerrouterz/v1/containers containers) dependenciesresponse_classtagsz /containersrequestfastapi_responseuser_api_key_dictcNKddlm}m}m}m}m}m}m} m} m } m } m } t|d{}t|xs&t|xst|d{xsd}||d<t!|} |j#|||d|||||d| | | | || d{} t)||| d{S77\7#t$$r#}|j'|||| d{7d}~wwxYw79#t*$rt$$r"}t-j.d ||cYd}~Sd}~wwxYww) aH Container creation endpoint for creating new containers. Follows the OpenAI Containers API spec: https://platform.openai.com/docs/api-reference/containers Example: ```bash curl -X POST "http://localhost:4000/v1/containers" -H "Authorization: Bearer sk-1234" -H "Content-Type: application/json" -d '{ "name": "My Container", "expires_after": { "anchor": "last_active_at", "minutes": 20 } }' ``` Or specify provider via header: ```bash curl -X POST "http://localhost:4000/v1/containers" -H "Authorization: Bearer sk-1234" -H "custom-llm-provider: azure" -H "Content-Type: application/json" -d '{ "name": "My Container" }' ``` r general_settings llm_router proxy_configproxy_logging_objselect_data_generator user_api_baseuser_max_tokens user_modeluser_request_timeoutuser_temperatureversionrNopenaicustom_llm_providerdataacreate_containerrrr route_typer%r#r"r$r&modelr)r+r*r(r'r,err%r,responserr/zkContainer ownership recording failed after upstream create; returning response with untracked ownership: %s)litellm.proxy.proxy_serverr"r#r$r%r&r'r(r)r*r+r,rrrrrbase_process_llm_request Exception_handle_llm_api_exceptionrrr exception)rrrr"r#r$r%r&r'r(r)r*r+r,r1r/ processorr9r7s p/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/container_endpoints/endpoints.pycreate_containerrAs|`    +7;;D 5WE  5g F :7K K   #6D 5$?I ) B B-/*/!-%"7!-!5+'!!C!  >+/ 3   c< L $  77// 8         && >   s*D%B7/D%B9D%7$B=B;B=!C.2C,3C.6D%9D%;B== C)C$C!C$$C))D%,C..D"DD"D%D""D%cKddlm}m}m}m}m}m}m} m} m } m } m } t|j}d|i}t|xst|xsd}||d<t!|} |j#|||d|||||d | | | | || d {}t)||| d {S7#t$$r#}|j'|||| d {7d }~wwxYw75w) a Container list endpoint for retrieving a list of containers. Follows the OpenAI Containers API spec: https://platform.openai.com/docs/api-reference/containers Example: ```bash curl -X GET "http://localhost:4000/v1/containers?limit=20&order=desc" -H "Authorization: Bearer sk-1234" ``` Or specify provider via header or query param: ```bash curl -X GET "http://localhost:4000/v1/containers?custom_llm_provider=azure" -H "Authorization: Bearer sk-1234" ``` rr! query_paramsr-r.r/r0alist_containersNr3r6r8)r:r"r#r$r%r&r'r(r)r*r+r,dictrCrrrr;r<r=r)rrrr"r#r$r%r&r'r(r)r*r+r,rCr1r/r?r9r7s r@list_containersrFs+F    w334L#1<"@D 5WE  5g F  #6D 5$?I ) B B-/)/!-%"7!-!5+'!!C!  <0+/ = $  77// 8      sTA#C&$B' B% B'C C!C%B'' C0CC  CCCz/v1/containers/{container_id}z/containers/{container_id} container_idcKddlm}m}m}m}m}m} m} m} m } m } m }d|i}t|xst|xsd}t|||d{\}}|jt!|||d{t#|} |j%|||d |||||d| | | | | | d{S7a7@7#t&$r#}|j)|||| d{7d}~wwxYww) a  Container retrieve endpoint for getting details of a specific container. Follows the OpenAI Containers API spec: https://platform.openai.com/docs/api-reference/containers Example: ```bash curl -X GET "http://localhost:4000/v1/containers/cntr_123" -H "Authorization: Bearer sk-1234" ``` Or specify provider via header: ```bash curl -X GET "http://localhost:4000/v1/containers/cntr_123" -H "Authorization: Bearer sk-1234" -H "custom-llm-provider: azure" ``` rr!rGr-r.rGrr/Nr0aretrieve_containerr3r6r:r"r#r$r%r&r'r(r)r*r+r,rrrupdaterrr;r<r=rrGrrr"r#r$r%r&r'r(r)r*r+r,r1r/original_container_idr?r7s r@retrieve_containerrOs?J    $2<"@D 5WE  5g F  8X!+/82..  KK-  !   5$?I 77-/,/!-%"7!-!5+'!8   !2   $  77// 8     fAC'B2"C'3B44C' $B8-B6.B81C'4C'6B88 C$CCCC$$C'cKddlm}m}m}m}m}m} m} m} m } m } m }d|i}t|xst|xsd}t|||d{\}}|jt!|||d{t#|} |j%|||d |||||d| | | | | | d{S7a7@7#t&$r#}|j)|||| d{7d}~wwxYww) a Container delete endpoint for deleting a specific container. Follows the OpenAI Containers API spec: https://platform.openai.com/docs/api-reference/containers Example: ```bash curl -X DELETE "http://localhost:4000/v1/containers/cntr_123" -H "Authorization: Bearer sk-1234" ``` Or specify provider via header: ```bash curl -X DELETE "http://localhost:4000/v1/containers/cntr_123" -H "Authorization: Bearer sk-1234" -H "custom-llm-provider: azure" ``` rr!rGr-r.rINr0adelete_containerr3r6rKrMs r@delete_containerrSps?J    $2<"@D 5WE  5g F  8X!+/82..  KK-  !   5$?I 77-/*/!-%"7!-!5+'!8   !2   $  77// 8     rP)!register_container_file_endpointsN)*typingrrfastapirrrrr fastapi.responsesr litellm._loggingr litellm.proxy._types$litellm.proxy.auth.user_api_key_authr r'litellm.proxy.common_request_processingr-litellm.proxy.common_utils.http_parsing_utilsr0litellm.proxy.common_utils.openai_endpoint_utilsrrr+litellm.proxy.container_endpoints.ownershiprrrrr__annotations__postrAgetrFstrrOdeleterS1litellm.proxy.container_endpoints.handler_factoryrTr@rgsHH,1"RQL  +,-!    +,-!   )00A(Bu uu&u  up+,-!    +,-!   )00A(BX XX&X  Xv#+,-!     +,-!   )00A(B Z Z Z Z & Z  Z z#+,-!    +,-!  )00A(B Z Z Z Z & Z  Z |"&)rf