Compose and Optimize Multiple APIs
The SliceX AI Medley design was inspired by rapid progress seen in computer architectures whereby computing machines in the past evolved from SISD (Single Instruction Single Data stream ) to MIMD (Multiple Instruction Multiple Data stream) architectures. This led to breakthrough progress in the computing paradigm and the widespread use of parallelized computing in a number of application areas. SliceX AI aims to drive similar breakthroughs and adoption of the AI-powered computing paradigm of the future.
SliceX Medley introduces the following AI-computing architecture configurations in our Cloud Platform:
- SISD: Single Inference, Single Data stream
- SIMD: Single Inference, Multiple Data stream
- MISD: Multiple Inference, Single Data stream
- MIMD: Multiple Inference, Multiple Data stream
Each SliceX API corresponds to an AI-processing unit and is accessed from the pool of SliceX Predictor APIs available to the customer.
Default operation
SISD is the default option when you use SliceX AI Predictor for inference, where a single SliceX API (e.g., Sentiment) is accessed to make a prediction on a single input query.
curl -X POST \
"https://api.slicex.ai/predictor/language/pre-trained/customer-review" \
-H "accept: application/json" \
-H "x-api-key: API_KEY"
-H "Content-Type: application/json" \
-d "{ \"query\": \"This restaurant was amazing, I really liked the chicken there.\"}""
Operating on Multiple Data streams
The SliceX Medley enables Multiple Data stream operations (for SIMD, MIMD) available to you via the Batch Inference endpoint. You can use it to run predictions on a batch of queries simultaneously.
curl -X POST \
"https://api.slicex.ai/medley/language/batch/pre-trained/customer-review" \
-H "accept: application/json" \
-H "x-api-key: API_KEY" \
-H "Content-Type: application/json" \
-d "{ \"queries\": [ \"This restaurant was really nice!\", \"I didn't like this movie\", \"Great job! keep up the good work!\" ]}"
Operating with Multiple Inference streams
The SliceX Medley makes Multiple Inference operations (for MISD, MIMD) available to you via the SliceX AI Medley endpoint. You can use it to simultaneously run multiple SliceX AI APIs on an input query. Please note that currently, this is available only for some subscription tiers (see the Pricing Section) and limited to running 2 APIs concurrently.
curl -X 'POST' \
'https://api.slicex.ai/medley/language' \
-H 'accept: application/json' \
-H 'Content-Type: application/json' \
-H 'X-API-Key: YOUR_SLICEX_API_KEY' \
-d '{
"query": "This movie was great",
"models": [
"sentiment-classification",
"emotion-detection"
]
}'
Use SliceX Medley with different configuration modes to combine and build an AI configuration that is suited to your workload and product needs.