Skip to main content

Compose and Optimize Multiple APIs

The SliceX AI Medley design was inspired by rapid progress seen in computer architectures whereby computing machines in the past evolved from SISD (Single Instruction Single Data stream ) to MIMD (Multiple Instruction Multiple Data stream) architectures. This led to breakthrough progress in the computing paradigm and the widespread use of parallelized computing in a number of application areas. SliceX AI aims to drive similar breakthroughs and adoption of the AI-powered computing paradigm of the future.

SliceX Medley introduces the following AI-computing architecture configurations in our Cloud Platform:

  • SISD: Single Inference, Single Data stream
  • SIMD: Single Inference, Multiple Data stream
  • MISD: Multiple Inference, Single Data stream
  • MIMD: Multiple Inference, Multiple Data stream

Each SliceX API corresponds to an AI-processing unit and is accessed from the pool of SliceX Predictor APIs available to the customer.

Default operation

SISD is the default option when you use SliceX AI Predictor for inference, where a single SliceX API (e.g., Sentiment) is accessed to make a prediction on a single input query.

Single Query Inference Request
curl -X POST \
"https://api.slicex.ai/predictor/language/pre-trained/customer-review" \
-H "accept: application/json" \
-H "x-api-key: API_KEY"
-H "Content-Type: application/json" \
-d "{ \"query\": \"This restaurant was amazing, I really liked the chicken there.\"}""

Operating on Multiple Data streams

The SliceX Medley enables Multiple Data stream operations (for SIMD, MIMD) available to you via the Batch Inference endpoint. You can use it to run predictions on a batch of queries simultaneously.

Batch Inference Request
curl -X POST \
"https://api.slicex.ai/medley/language/batch/pre-trained/customer-review" \
-H "accept: application/json" \
-H "x-api-key: API_KEY" \
-H "Content-Type: application/json" \
-d "{ \"queries\": [ \"This restaurant was really nice!\", \"I didn't like this movie\", \"Great job! keep up the good work!\" ]}"

Operating with Multiple Inference streams

The SliceX Medley makes Multiple Inference operations (for MISD, MIMD) available to you via the SliceX AI Medley endpoint. You can use it to simultaneously run multiple SliceX AI APIs on an input query. Please note that currently, this is available only for some subscription tiers (see the Pricing Section) and limited to running 2 APIs concurrently.

Medley Inference Request
curl -X 'POST' \
'https://api.slicex.ai/medley/language' \
-H 'accept: application/json' \
-H 'Content-Type: application/json' \
-H 'X-API-Key: YOUR_SLICEX_API_KEY' \
-d '{
"query": "This movie was great",
"models": [
"sentiment-classification",
"emotion-detection"
]
}'

Use SliceX Medley with different configuration modes to combine and build an AI configuration that is suited to your workload and product needs.