The Real Time Market Data Server
RMD Server is our high-performance database solution for real-time market data.
RMD Server is used by top hedge funds and data providers around the world to store and retrieve multi-terabyte volumes of market data.
One of RMD Server's key strengths is its ability to very quickly locate and return segments of historic market data, which may be buried deep within a historic market database. This key benefit allows data providers to quickly return historic data to clients and allows trading strategy developers to test their trading strategies as quickly and efficiently as possible.
Any in-depth study of the method in which Time Series Analysis (TSA) results are obtained reveals that a structured relational database is the last way time series data should be stored.
"Having an RDBMS doesn't mean instant decision-support nirvana. As enabling as RDBMSs have been for users, they were never intended to provide powerful functions for data synthesis, analysis, and consolidation (functions collectively known as multidimensional data analysis)." - Ted Codd, inventor of the relational database model, 1993
If the man who invented the modern-day computer database doesn't think that it is suited for data analysis, why do we insist on storing data in them?
A look at traditional data storage
SQL databases consist of a set of row/column-based "tables," indexed by a "data dictionary." A table is a "container" which stores data. In reality, a table looks a lot like a spreadsheet, as it is composed of rows (records), and each row is composed of columns (fields). A collection of related tables is known as a relational database.
Using the very flexible SQL (structured query language), one can retrieve data from any table, or groups of related tables, and present that data as a "view."
This basic functionality, and the flexibility to store and relate almost anything, is what makes the relational database management system (RDBM) so powerful and so widely used for nearly every serious business application.
Unfortunately, this "one size fits all" approach to data storage and retrieval is exactly why the RDBM model fails so miserably for financial analysis and reporting applications.
The RDBM model produces substantial overhead due to its inherent multiple row and table record structures. When you heap indices, clusters, and procedures on top, you create even more overhead which slows down performance considerably.
Since all RDBMS records are equally "important" to the database, they are not optimized for speed.
Also, since an RDBMS has no inherent data compression methods, they are usually combined with exception reporting and averaging techniques, which may result in data loss and inaccurately reproduced data.
RDBMS Are Too Slow
Typically the speed of an RDBMS writing to the hard drive is quite slow. Major RDBMS vendors often claim benchmarks which include very high transactions per second (TPS). What they don't say: the TPS speed refers to actions performed on the data after it is already in the database, and not to the speed at which it is written to the database or the data retrieval speed. What goes on inside of the database is of little interest to the end user. The data acquisition speed, and the actual time it takes to put a set of results onto the screen, is where money is made and lost.
An additional SQL drawback, regarding any financial-based data reporting, is that statistics are not automatically calculated by the RDBMS because SQL mathematics is limited to sums, minimums, maximums, and averages.
Worse, a traditional RDBMS is generally limited to a one-second-time resolution. This is a problem when you are acquiring high burst quantities of data with sub second time stamps.
The ideal solution for the financial industry is a storage and retrieval methodology which is able to access data in a nearly instantaneous manner and then calculate the statistics for a given time span "on the fly," without the overhead of a RDBMS.
RMD Server is a new data retrieval methodology engineered specifically for financial time series analyses.
RMD Server uses a new generation of data storage which is specially optimized for the financial analysis industry.
At the heart of RMD Server is a patented search algorithm, JADE™. RMD Server is capable of scanning through terabytes of data to search for specific records hundreds of times faster than the fastest RDBMS.
"Our innovative JADE search algorithm enables RMD Server to outperform industry standard RDBMS products like SQL Server by many times in terms of speed and efficiency for time series analysis."
RMD Server is available as a stand-alone server product which may be used with most development languages, including C++, C#, and Java, via the included Application Programmers Interface (API).
Easy SetupRMD Server is easy to deploy. A database installation wizard guides you through the setup process and automatically sets up your databases.
Example Application Support
RMD Server comes with example applications to get you started quickly. You can develop and maintain a complete data service, complete with data subscriber administration, access restrictions based on symbol groups, account expiration management, and more.
The RMD Server Administrator lets you easily manage your RMD Server instance. Using the built-in features, you can perform the following:
- Create and edit databases in RMD Server
- Manage logins (admin or remote users / data subscribers)
- Perform ad-hoc queries and output the results
With RMD Server, you can aggregate data feeds into one database, perform time series analyses and update data in real time. It is designed for enterprise scale database applications, such as powering a ticker plant or managing data for financial web sites.
Get Started with RMD Server >
Why Choose Modulus?
Modulus is a financial technology company. While that may not sound like a real differentiator, it is. It means that our solutions come from our years of experience in the financial technology industry. Our products and services are provided by developers and engineers who have first-hand trading experience. Everyone here at Modulus speaks your language.
Read more about us.