A system and method for the parallel execution of database queries over cpus and multi core processors

Système et procédé d'exécution parallèle d'interrogations de base de données sur des cpu et des processeurs multicœurs


The invention relates to a system for parallel execution of database queries over one or more Central Processing Units (CPUs), and one or more Multi Core Processors, (MCPs), the system comprises: (a) a query analyzer for dividing the query to plurality of sub- queries, and for computing and assigning to each sub-query a target address of either a CPU of an MCP; (b) a query compiler for creating an Abstract Syntax Tree (AST) and OpenCL primitives only for those sub-queries that are targeted to an MCP, and for conveying both the remaining sub-queries, and the AST and the OpenCL code to a virtual machine, and (A) a Virtual Machine (VM) which comprises: a task bank, a buffers; a scheduler. The virtual machine combines said sub-query results by the CPUs and said primitive results by said MCPs to a final query result.
L'invention porte sur un système d'exécution parallèle d'interrogations de base de données sur une ou plusieurs unités centrales (CPU) et un ou plusieurs processeurs multicœurs (MCP), le système comprenant : (a) un analyseur d'interrogation pour diviser l'interrogation en une pluralité de sous-interrogations, et pour calculer et attribuer à chaque sous-interrogation une adresse cible soit d'une CPU soit d'un MCP; (b) un compilateur d'interrogation pour créer un arbre de syntaxe abstraite (AST) et des primitives OpenCL uniquement pour les sous-interrogations dont la cible est un MCP, et pour acheminer à la fois les sous-interrogations restantes et l'AST et le code OpenCL vers une machine virtuelle, et (A) une machine virtuelle (VM) qui comprend : une banque de tâches, des tampons; un ordonnanceur. La machine virtuelle combine les résultats de sous-interrogation obtenus par les CPU et les résultats de primitive obtenus par les MCP en un résultat d'interrogation final.




Download Full PDF Version (Non-Commercial Use)

Patent Citations (3)

    Publication numberPublication dateAssigneeTitle
    US-2005131893-A1June 16, 2005Sap AktiengesellschaftDatabase early parallelism method and system
    US-2006218123-A1September 28, 2006Sybase, Inc.System and Methodology for Parallel Query Optimization Using Semantic-Based Partitioning
    US-5495606-AFebruary 27, 1996International Business Machines CorporationSystem for parallel processing of complex read-only database queries using master and slave central processor complexes

NO-Patent Citations (2)

    HE ET AL.: "Relational Query Co-Processing on Graphies Processors.", ACM, December 2009 (2009-12-01), pages 8 - 9, 18-22, XP009150443, Retrieved from the Internet [retrieved on 20111127]
    See also references of EP 2596430A1

Cited By (22)

    Publication numberPublication dateAssigneeTitle
    EP-2972840-A4November 02, 2016Hewlett Packard Entpr Dev LpKoprozessorbasierte array-orientierte datenbankverarbeitung
    NL-2012436-ASeptember 16, 2014Palantir TechnologiesFair scheduling for mixed-query loads.
    US-2015242487-A1August 27, 2015Sqream Technologies Ltd.System and a method for executing sql-like queries with add-on accelerators
    US-9384203-B1July 05, 2016Palantir Technologies Inc.Systems and methods for indexing and aggregating data records
    US-9454281-B2September 27, 2016Palantir Technologies Inc.System for providing dynamic linked panels in user interface
    US-9454564-B1September 27, 2016Palantir Technologies Inc.Data integrity checks
    US-9514200-B2December 06, 2016Palantir Technologies Inc.Systems and user interfaces for dynamic and interactive simultaneous querying of multiple data stores
    US-9542446-B1January 10, 2017Palantir Technologies, Inc.Automatic generation of composite datasets based on hierarchical fields
    US-9576003-B2February 21, 2017Palantir Technologies, Inc.Providing unique views of data based on changes or rules
    US-9639578-B2May 02, 2017Palantir Technologies, Inc.System and method for investigating large amounts of data
    US-9672257-B2June 06, 2017Palantir Technologies Inc.Time-series data storage and processing database system
    US-9715526-B2July 25, 2017Palantir Technologies, Inc.Fair scheduling for mixed-query loads
    US-9753935-B1September 05, 2017Palantir Technologies Inc.Time-series data storage and processing database system
    US-9798787-B1October 24, 2017Palantir Technologies Inc.System and user interfaces for searching resources and related documents using data structures
    US-9805071-B1October 31, 2017Palantir Technologies Inc.System and methods for live data migration
    US-9817563-B1November 14, 2017Palantir Technologies Inc.System and method of generating data points from one or more data stores of data items for chart creation and manipulation
    US-9836499-B1December 05, 2017Palantir Technologies Inc.Data integrity checks
    US-9852205-B2December 26, 2017Palantir Technologies Inc.Time-sensitive cube
    US-9880987-B2January 30, 2018Palantir Technologies, Inc.System and method for parameterizing documents for automatic workflow generation
    US-9880993-B2January 30, 2018Palantir Technologies, Inc.System and method for accessing rich objects via spreadsheets
    WO-2014139140-A1September 18, 2014Hewlett-Packard Development Company, L.P.Co-processor-based array-oriented database processing
    WO-2014147617-A1September 25, 2014Sqream Technologies LtdProcédé pour l'exécution de requêtes sur des données diffusées en mode au fil de l'eau au moyen d'unités de traitement graphique