SDK¶

• Tutorial
  • About processors
    • Annotation
    • Rejection
    • Modification
  • Before you begin
  • Install the SDK
  • Create a basic processor which annotates a request
  • Run the processor locally
  • Use the processor with AI Gateway
  • How to reject a request
  • Modify a request
  • Act on the response from the upstream LLM
  • Completed tutorial processor
• Implementation scenarios
  • Parameter validation
• SDK Reference
  • ProcessExecutionError
  • ProcessorError
  • Choice
    • Choice.model_config
  • Message
    • Message.model_config
  • MessageRole
  • Parameters
    • Parameters.otel_attributes()
    • Parameters.model_config
  • Processor
    • Processor.choose_span()
    • Processor.handle_request()
    • Processor.process()
    • Processor.process_input()
    • Processor.process_response()
    • Processor.app_details
    • Processor.methods
    • Processor.name
    • Processor.namespace
    • Processor.namespaced_path
    • Processor.parameters_class
    • Processor.path
    • Processor.prompt_type
    • Processor.response_type
    • Processor.signature
    • Processor.version
  • ProcessorRoutes
  • Reject
    • Reject.is_empty()
    • Reject.to_multipart_field()
    • Reject.to_response()
    • Reject.model_config
  • RejectCode
  • RequestInput
    • RequestInput.concatenate()
    • RequestInput.hash()
    • RequestInput.to_multipart_field()
    • RequestInput.model_config
  • ResponseOutput
    • ResponseOutput.hash()
    • ResponseOutput.to_multipart_field()
    • ResponseOutput.choices
    • ResponseOutput.model_config
  • Result
    • Result.check_prompt_or_response()
    • Result.to_response()
    • Result.validate_allowed()
    • Result.is_empty
    • Result.model_config
    • Result.modified
  • Signature
    • Signature.supports_input()
    • Signature.supports_response()
    • Signature.to_list()
  • SignatureField
  • Tags
    • Tags.add_tag()
    • Tags.get_all_tags()
    • Tags.get_tags()
    • Tags.model_post_init()
    • Tags.remove_key()
    • Tags.remove_tag()
    • Tags.to_response()
    • Tags.model_config