Neural Solution is a flexible and easy to use tool that brings the capabilities of Intel® Neural Compressor as a service. With Neural Solution, Users can effortlessly submit optimization tasks through the RESTful/gRPC APIs. Neural Solution automatically dispatches these tasks to one or multiple nodes, streamlining the entire process.
- Task Parallelism: Neural Solution automatically schedules the optimization task queue by coordinating available resources and allows execution of multiple optimization tasks simultaneously.
- Tuning Parallelism: Neural Solution accelerates the optimization process by seamlessly parallelizing the tuning across multiple nodes.
- APIs Support: Neural Solution supports both RESTful and gRPC APIs, enabling users to conveniently submit optimization tasks.
- Code Less: When working with Hugging Face models, Neural Solution seamlessly integrates the functionality of the Neural Coder, eliminating the need for any code modifications during the optimization process.
There are two ways to install the neural solution:
pip install neural-solution
# get source code
git clone https://github.com/intel/neural-compressor
cd neural-compressor
# install neural compressor
pip install -r requirements.txt
python setup.py install
# install neural solution
pip install -r neural_solution/requirements.txt
python setup.py neural_solution install- The Architecture documents
- APIs Reference
Please contact us at [email protected] for any Neural Solution related question.