Problem

Currently, both model training and inference are provided by centralized service providers. However, their services have the following issues:

  • Inability to use models freely:

    • Models provided by centralized service providers face licensing and censorship restrictions. The models' ability to answer questions is limited, leading to diminished user experience.

  • Lack of free circulation of models:

    • Centralized model hosting providers impose various reviews on the models they host, restricting normal model providers from offering their models freely.

  • Lack of model diversity:

    • Centralized service providers often create models to address general problems, while real user needs are diverse and require more customized models from different providers.

  • Data privacy concerns:

    • When centralized providers obtain training data, there are risks of data loss or unauthorized misuse. This high-quality data is often the core asset of enterprises or individuals and must be safeguarded.

    • When engineers fine-tune models on centralized platforms, the fine-tuned models are often shared with other users for cost and profit maximization. Private data can easily be leaked through specially constructed prompts, which is unacceptable.

  • High computational costs:

    • Small to medium-sized users often cannot afford expensive GPU equipment necessary for large-scale AI training. Current cloud services do not significantly reduce these costs.

Last updated