concurrent DML / DDL

5 posts / 0 new
Last post
srand
srand's picture
Offline
Last seen: 3 years 9 months ago
Joined: Dec 21 2009
Junior Boarder

Posts: 11

cyril scetbon
concurrent DML / DDL

We're thinking about migrating our datawarehouse from MySQL to InfiniDB, but as users provide our datawarehouse, we need concurrent DML and this is a crucial point !

thank you for your work

ricardo.edo
ricardo.edo's picture
Offline
Last seen: 2 years 10 months ago
Joined: Nov 19 2011
Junior Boarder

Posts: 2

Ricardo Edo
Re: concurrent DML / DDL

I was planning to migrate our data warehouse to InfiniDB from Oracle but is mandatory to have this capabilities.

How do you espect that we use ETl with this limitation? It´s impossible....

radams
radams's picture
Offline
Last seen: 1 hour 40 min ago
Joined: Jan 3 2011
Administrator

Posts: 493

Robert Adams
Re: concurrent DML / DDL

Hi,

Execution of concurrent DDL/DML statements is not support in the current release of the Calpont
InfiniDB. Additional transactions beyond the first will wait until the first transaction has committed before executing.

We do not recommend using DML to load data into InfinDB. DML is a row by row process and is therefore very slow. We have a tool called cpimport which is capable of loading a very large number of rows into the database. Please check out our Concepts Guide to see how this works.

Thanks,

Robert
Calpont

ricardo.edo
ricardo.edo's picture
Offline
Last seen: 2 years 10 months ago
Joined: Nov 19 2011
Junior Boarder

Posts: 2

Ricardo Edo
Re: concurrent DML / DDL

thanks for your reply.

I know cpimport but it is insufficient to populate a data warehouse every day, for example, to load slowly changing dimensions or to refresh dimensions and fact tables in the same transformation.

I have been testing InfiniDB with my data and the query response is impresive vs my database using R-OLAP cubes, I get near instant response vs several minutes, but it´s imposible to put this database on a production enviroment with our etl processes with this limitation.

radams
radams's picture
Offline
Last seen: 1 hour 40 min ago
Joined: Jan 3 2011
Administrator

Posts: 493

Robert Adams
Re: concurrent DML / DDL

Hi,

We have quite a few customers who have found that by using the flexibility that InfiniDB provides they can quite easily adapt their process to work very efficiently.

Here is an article that describes how that can work.

http://www.infinidb.org/component/content/article/53/225

Thanks,

Robert