Dolly v2.0 12B

  • v1

bbreton3/banana-dolly-v2-12B

Deploy on Banana for fast, affordable, and easy deployment of Dolly v2.0 12B. Get results fast with our user-friendly interface, unbeatable pricing and speed. Click the button above to deploy this model now!

Readme

INPUT

{
  "prompt": "Tell me a story about a cat",
  "do_sample": true,
  "max_new_tokens": 256,
  "top_p": 0.92,
  "top_k": 0
}

OUTPUT

{
  "output": "Once upon a time..",
  "prompt": "Tell me a story about a cat",
  "do_sample": true,
  "max_new_tokens": 256,
  "top_p": 0.92,
  "top_k": 0,
  "inference_time": 0.6
}

CODE SNIPPETS


import banana_dev as banana

model_inputs = {
  "prompt": "Tell me a story about a cat",
  "do_sample": true,
  "max_new_tokens": 256,
  "top_p": 0.92,
  "top_k": 0
}

api_key = "YOUR_API_KEY"
model_key = "YOUR_MODEL_KEY"

# Run the model
out = banana.run(api_key, model_key, model_inputs)
logo