Subscribe To Our Free AI Newsletter 📰

Petals

Share This Tool

Short Description
SKU c54e7837e0cd Category Tags ,
Long Description

The Petal tool is a decentralized platform that utilizes a powerful language model called Bloom-176b. It can load and process specific sections of the model for inference and fine-tuning tasks. With a single-batch inference, each step (token) takes around 1 second to execute, and it can execute parallel inference at a rate of hundreds of tokens per second. Unlike a typical language model API, Petal provides additional features such as fine-tune sampling methods, the ability to follow custom paths, and visibility into hidden states. Additionally, Petal includes a flexible PyTorch API. This tool is developed as part of the BigScience research workshop project.

Reviews

There are no reviews yet.

Be the first to review “Petals”

Your email address will not be published. Required fields are marked *


The reCAPTCHA verification period has expired. Please reload the page.

Related AI