February 21, 2014 | jtommaney
InfiniDB TnT: High Speed load with InfiniDB
InfiniDB has multiple methods of loading, with different characteristics. Loading data via Insert or “load data infile” are SQL based transactional methods, but are not suited for loading your largest tables. InfiniDB’s fastest and most parallel load method is CPImport, the high speed data external utility.
- Scalable - each node in an InfiniDB cluster can load independently to local extents of the table. This allows for scaling the load rate as you scale your cluster.
- Fast - CPImport is extremely fast, loading at approximately ½ million rows per second per server, 100x to 1000x faster than the next quickest load rate.
Do you have questions about how to load your biggest tables into InfiniDB? Let us know in the comments, below, via email at firstname.lastname@example.org, or on Twitter @infiniDB.