Ongoing list of errors that InfiniDB throws me

6 posts / 0 new
Last post
MikesBikes
MikesBikes's picture
Offline
Last seen: 2 years 2 months ago
Joined: Jul 10 2012
Junior Boarder

Posts: 1

MICHAEL FUERY
Ongoing list of errors that InfiniDB throws me

Given a table like:
CREATE TABLE `hsa_ai_log` (
`serial_id` bigint(20) DEFAULT NULL,
`date_stamp_1000` datetime DEFAULT NULL,
`ds` date DEFAULT NULL,
`hsa_partner_id` int(11) DEFAULT NULL,
`hsa_site_id` int(11) DEFAULT NULL,
`hsa_zone_id` int(11) DEFAULT NULL,
`dart_ad_id` int(11) DEFAULT NULL,
`dart_creative_id` int(11) DEFAULT NULL,
`dart_advertiser_id` int(11) DEFAULT NULL,
`dart_keyword_ordinal` smallint(5) DEFAULT NULL,
`hsa_ai_ad_product_id` smallint(5) DEFAULT NULL,
`date_stamp_2100` datetime DEFAULT NULL,
`date_stamp_2500` datetime DEFAULT NULL,
`cookie` char(48) DEFAULT NULL,
`dma_id` int(11) DEFAULT NULL,
`hsdir_object_id` int(11) DEFAULT NULL,
`query_string` varchar(2048) DEFAULT NULL,
`client_ip` varchar(255) DEFAULT NULL,
`host_name` varchar(2048) DEFAULT NULL,
`user_agent` varchar(2048) DEFAULT NULL,
`mac_address` varchar(255) DEFAULT NULL,
`udid` varchar(255) DEFAULT NULL,
`lat` double DEFAULT NULL,
`lon` double DEFAULT NULL,
`device_wurfl_id` varchar(255) DEFAULT NULL,
`hsdir_object_type_id` int(11) DEFAULT NULL,
`keywords` varchar(2048) DEFAULT NULL,
`known_previously` tinyint(1) DEFAULT NULL,
`ad_view_tm` smallint(4) DEFAULT NULL
) ENGINE=InfiniDB DEFAULT CHARSET=latin1;

With between 10 and 50 million rows per day (ds)...

select count(1) from hsa_ai_log where ds='2012-06-17';
An unexpected condition within the query caused an internal processing error within InfiniDB. Please check the log files for more details. Additional Information: error in BatchPrimitiveProcessor projectResult. Please check crit.log for more details.

delete from hsa_ai_log where ds='2012-06-17';
CAL0002: Delete Failed: CAL0002: Delete Failed: columncommand.cpp error on projectResultRG for oid 63454 lbid 428984544: input rids 8192, output rids 0

mfuery
mfuery's picture
Offline
Last seen: 1 year 10 months ago
Joined: Aug 5 2011
Junior Boarder

Posts: 3

michael fuery
Re: Ongoing list of errors that InfiniDB throws me

A table that is ~20million rows:
RENAME TABLE datatrain.hsa_daily_log_summary_intermediate TO datatrain._v1_11_hsa_daily_log_summary_intermediate;

This COMPLETELY locks the ENTIRE database from any reads and writes. Cannot conduct any selects: so far as I know, I am only able to get this processlist.

In what universe is it acceptable to lock out all users+apps when you need to do DDLs?

[code]+--------+-----------+--------------------+--------------+---------+------+----------------------+------------------------------------------------------------------------------------------------------+
| Id | User | Host | db | Command | Time | State | Info |
+--------+-----------+--------------------+--------------+---------+------+----------------------+------------------------------------------------------------------------------------------------------+
| 55322 | datatrain | 10.10.10.29:54519 | hsa | Query | 180 | NULL | drop table infinidb_vtable.$vtable_55322 restrict |
| 116915 | datatrain | 10.20.40.245:48883 | NULL | Query | 2398 | checking permissions | RENAME TABLE datatrain.hsa_daily_log_summary_intermediate TO datatrain._v1_11_hsa_daily_log_summary_ |
| 116917 | datatrain | 10.20.40.245:49026 | hsa | Query | 2332 | NULL | drop table infinidb_vtable.$vtable_116917 restrict |
| 116918 | datatrain | 10.20.40.245:49027 | hsa | Query | 2332 | NULL | drop table infinidb_vtable.$vtable_116918 restrict |
| 116919 | nagios | 10.20.0.20:60791 | hsa_infinidb | Query | 2285 | NULL | drop table infinidb_vtable.$vtable_116919 restrict |
| 116920 | datatrain | 10.20.40.245:49139 | hsa | Query | 2273 | NULL | drop table infinidb_vtable.$vtable_116920 restrict |
| 116921 | datatrain | 10.20.40.245:49140 | hsa | Query | 2273 | NULL | drop table infinidb_vtable.$vtable_116921 restrict |
| 116922 | datatrain | 10.20.40.245:49154 | hsa | Quer

mfuery
mfuery's picture
Offline
Last seen: 1 year 10 months ago
Joined: Aug 5 2011
Junior Boarder

Posts: 3

michael fuery
Re: Ongoing list of errors that InfiniDB throws me

haha - this is ridiculous

[code]+--------+-----------+---------------------+--------------+---------+------+----------------------+------------------------------------------------------------------------------------------------------+
| Id | User | Host | db | Command | Time | State | Info |
+--------+-----------+---------------------+--------------+---------+------+----------------------+------------------------------------------------------------------------------------------------------+
| 55322 | datatrain | 10.10.10.29:54519 | hsa | Query | 2709 | NULL | drop table infinidb_vtable.$vtable_55322 restrict |
| 116915 | datatrain | 10.20.40.245:48883 | NULL | Query | 4927 | checking permissions | RENAME TABLE datatrain.hsa_daily_log_summary_intermediate TO datatrain._v1_11_hsa_daily_log_summary_ |
| 116917 | datatrain | 10.20.40.245:49026 | hsa | Query | 4861 | NULL | drop table infinidb_vtable.$vtable_116917 restrict |
| 116918 | datatrain | 10.20.40.245:49027 | hsa | Query | 4861 | NULL | drop table infinidb_vtable.$vtable_116918 restrict |
| 116919 | nagios | 10.20.0.20:60791 | hsa_infinidb | Query | 4814 | NULL | drop table infinidb_vtable.$vtable_116919 restrict |
| 116920 | datatrain | 10.20.40.245:49139 | hsa | Query | 4802 | NULL | drop table infinidb_vtable.$vtable_116920 restrict |
| 116921 | datatrain | 10.20.40.245:49140 | hsa | Query | 4802 | NULL | drop table infinidb_vtable.$vtable_116921 restrict |
| 116922 | datatrain | 10.20.40.245:49154 | hsa | Query | 4800 | NULL | drop table infinidb_vtable.$vtable_116922 restrict |
| 116923 | datatrain | 10.20.40.245:49155 | hsa | Query | 4800 | NULL | drop table infinidb_vtable.$vtable_116923 restrict |
| 116924 | datatr

mfuery
mfuery's picture
Offline
Last seen: 1 year 10 months ago
Joined: Aug 5 2011
Junior Boarder

Posts: 3

michael fuery
Re: Ongoing list of errors that InfiniDB throws me

Infini seems to be lying to me...

mysql > TRUNCATE TABLE tablename;
ERROR 122 (HY000) at line 1: CAL0009: Truncate table failed: IDB-2009: Unable to perform the operation because DDLProc with PID 15106 is currently holding the table lock for session 116915.

# ps -A | grep 15106
yields no results.

mysql > SHOW PROCESSLIST;
[code]
+-----+-----------+-------------------+-----------+---------+------+-------+------------------+
| Id | User | Host | db | Command | Time | State | Info |
+-----+-----------+-------------------+-----------+---------+------+-------+------------------+
| 73 | datatrain | 10.10.10.29:64851 | datatrain | Sleep | 171 | | NULL |
| 123 | datatrain | 10.10.10.29:64903 | hsa | Sleep | 172 | | NULL |
| 360 | datatrain | 10.10.10.29:65242 | NULL | Query | 0 | NULL | SHOW PROCESSLIST |
+-----+-----------+-------------------+-----------+---------+------+-------+------------------+
[/code]

bdempsey
bdempsey's picture
Offline
Last seen: 1 month 3 weeks ago
Joined: Oct 27 2009
Platinum Boarder

Posts: 194

Robert Dempsey
Re: Ongoing list of errors that InfiniDB throws me

Renaming a table in InfiniDB should be nearly instantaneous and is irrespective to the size of the table. Truncating a table is probably close to linear by the number of rows mod 8 million.

It would appear that (at least) mysqld was restarted between the two posts above. The error indicates that InfiniDB thinks that session 116915 is still trying to rename the table. A restart of the InfiniDB instance should cause rollback to occur and should clear the transaction.

grishashvili
grishashvili's picture
Offline
Last seen: 6 days 19 hours ago
Joined: May 3 2014
Junior Boarder

Posts: 4

Henry Grishashvili
I also have this problem that

I also have this problem that Infinidb thinks the process is still holding a lock on a table.

 

Restarting InfiniDB is definitely not a solution for production environment. 

 

Is there a way to fix it somehow from the console?

 

Thanks

Henry