ShapedQL is a powerful recommendation query language that brings the familiarity of SQL to the world of ranking, retrieval, and personalization. Designed for ML engineers and data scientists building search and recommendation systems, it allows users to construct complex queries using a select-from-where syntax extended with domain-specific operations. With this language, teams can seamlessly blend text searches, image similarity, collaborative filtering, and learned scoring models into a single, readable expression. By leveraging intuitive syntax, it empowers rapid prototyping and reduces the time from idea to live, personalized features. The core value of ShapedQL lies in dramatically reducing the friction of prototyping and deploying retrieval pipelines. ShapedQL abstracts away the complexity of managing multiple retrieval backends, enabling teams to focus on relevance instead of infrastructure.
Building effective recommendation and search engines typically requires stitching together multiple disjointed components: vector databases, keyword indexes, scoring services, and re-ranking logic. This fragmentation leads to slow iteration cycles, difficulty in debugging, and a steep learning curve for new team members. ShapedQL addresses these challenges by unifying these varied capabilities under a single query language. Developers no longer need to write and glue together separate microservices; instead, they declare the entire retrieval and ranking plan in one place, which streamlines development and makes experimentation fast and repeatable. The result is a consistent, easy-to-read expression that can be version-controlled, shared, and optimized collaboratively, significantly cutting the time needed to launch and tune recommendation features. This declarative approach also makes it straightforward to A/B test different retrieval strategies by simply swapping out query components.
The first major feature group of ShapedQL is its familiar SQL-like syntax that is specifically enhanced for recommendation tasks. Queries are built using standard clauses such as SELECT, FROM, and WHERE, but extended to reference embedding fields, specify retrieval modes like hybrid search, and integrate collaborative signals. For example, you can write a query that selects movies from a catalog WHERE the title embedding is semantically similar to a text query, combined with a collaborative filter ON user interaction embeddings. This approach means that anyone with basic SQL knowledge can immediately start building sophisticated retrieval logic, lowering the barrier to entry while still exposing the full power of learned embeddings and deep models. Additionally, the language supports advanced operations like reordering, deduplication, and applying business rules directly within the same query, ensuring that all logic is centralized and transparent.
admin
A second key capability lies in the rich set of embedding types available for retrieval. In the ShapedQL Playground, the demo model includes title_embedding for semantic matching of movie titles, description_content_embedding for plot-based relevance, and poster_embedding for image similarity searches. Additionally, collaborative_embedding and people_also_liked embeddings enable user-item interaction-based recommendations, while personnel_embedding supports diversity and filtering by cast and crew. Each embedding can be referenced directly in a ShapedQL query, allowing developers to mix and match heterogeneous signals—semantic text, visual content, and behavioral patterns—within a single retrieval expression. This modularity means that a query can, for instance, retrieve items visually similar via poster_embedding and then boost those with high collaborative affinity, all without writing separate pipelines.
Beyond retrieval, ShapedQL includes advanced scoring and hybrid search capabilities. The playground features a click_through_rate model trained using LightGBM, which can be invoked in queries to order results by predicted user engagement. This learned scoring can be combined with a personalized reranker that adapts to individual user profiles. The language also natively supports hybrid search, blending lexical keyword matching with semantic vector similarity to improve recall and precision. By integrating these ranking and personalization features directly into the query, ShapedQL eliminates the need for separate post-processing steps, making the final output more directly aligned with business metrics like clicks or conversions. Moreover, the scoring models can be swapped or weighted dynamically, allowing fine-grained control over the trade-off between relevance and personalization. This integration ensures that the entire pipeline from retrieval to final ranking is expressed in a single, maintainable unit.
The ShapedQL Playground provides a hands-on environment to experience this workflow. It comes preloaded with the Movielens dataset, enriched with IMDb metadata, so users can immediately start experimenting. The interface guides you through selecting a use case—Agent retrieval, Search and feeds, or Recommendations—and then writing or selecting a ShapedQL expression. Upon execution, the query engine processes the expression against the live embeddings and scoring models, returning ranked results in the right-hand pane. This immediate feedback loop allows practitioners to gain intuition about embedding behaviors and scoring nuances, accelerating the development of production-grade retrieval pipelines. Because the dataset and embeddings are preconfigured, there is no setup overhead; users can focus entirely on query logic and ranking strategies. The playground also supports saving and reusing queries, making it easy to collaborate and share best practices across a team.
Concrete real-world scenarios illustrate the language’s versatility. A developer building a movie streaming service can use description_content_embedding to find films with plots similar to a user’s recently watched titles, then apply collaborative_embedding to boost items popular among similar users, and finally rank by click_through_rate to maximize engagement. An e-commerce team can employ hybrid search with lexical and semantic matching to handle a wide range of user queries, while a chatbot creator can leverage agent retrieval to fetch contextually relevant movie information based on natural language. The result in each case is a more tailored and effective search or recommendation experience, built with less code and fewer moving parts. Furthermore, a media company could utilize poster_embedding for visual browsing of movie thumbnails, allowing users to discover content by image similarity, while the personnel_embedding helps surface films featuring favorite actors or directors. Each scenario benefits from ShapedQL's ability to unify retrieval, filtering, and scoring in a single, auditable query.
ShapedQL is intended for ML engineers, data scientists, and software developers who are tasked with delivering high-quality search and recommendation features. Whether working on a consumer app, an internal tool, or a large-scale platform, these professionals benefit from the language’s unification of retrieval and ranking. The playground is entirely web-based, requiring no local setup, and the technology is designed for seamless integration into existing tech stacks via APIs. In summary, ShapedQL revolutionizes recommendation system development by combining the clarity of SQL with the power of modern embeddings and machine-learned scorers, enabling teams to create more intelligent and engaging user experiences faster. By empowering these roles to express complex ideas in a concise, readable format, ShapedQL fosters cross-functional collaboration and accelerates the journey from data to delight. Its immediate applicability to common search and feeds use cases makes it an essential tool for any organization serious about personalization.
ML engineers, data scientists, and search/recommendation system developers seeking a unified query interface for building and tuning retrieval pipelines. Also valuable for technical product managers evaluating tools to accelerate personalization efforts. The playground caters to those experimenting with embedding-based search, ranking, and recommendation algorithms, regardless of whether they are building consumer applications, internal tools, or large-scale platforms.