Apache SqoopTM – InfiniDBApache SqoopTM – InfiniDB Actual error row count(11) exceeds the max error rows(10) allowed for table

3 posts / 0 new
Last post
guoliufang
guoliufang's picture
Offline
Last seen: 1 month 3 weeks ago
Joined: Jul 1 2014
Junior Boarder

Posts: 6

LiuFang Guo
Apache SqoopTM – InfiniDBApache SqoopTM – InfiniDB Actual error row count(11) exceeds the max error rows(10) allowed for table

 

Hi
can you help me fix this problem first?
 
/usr/local/Calpnot/bin/sqoop export -D mapred.task.timeout=0 --direct --connect jdbc:mysql://192.168.11.81:3306/ad_next --username root  --export-dir /user/root/push/service.2014-07-04.log  --table push_logs --input-fields-terminated-by '|' 
 
 Jul 17 17:06:32 hyperv3 cpimport.bin[12780]: 32.684428 |0|0|0| E 34 CAL0087: BulkLoad Error: Actual error row count(11) exceeds the max error rows(10) allowed for table push_two.push_logs
Jul 17 17:06:32 hyperv3 cpimport.bin[12780]: 32.684931 |0|0|0| E 34 CAL0087: BulkLoad Error: Bulkload Read (thread 0) Failed for Table push_two.push_logs.  Terminating this job.
 
|Thank you .  
 
and the way 
/usr/local/Calpont/bin/colxml -e 
seemed have not effect on sqoop 
dhall@infinidb.co
dhall@infinidb.co's picture
Offline
Last seen: 2 months 2 days ago
Joined: Jul 19 2014
Junior Boarder

Posts: 2

David Hall , Engineer
Gender: Male
Apache SqoopTM – InfiniDBApache SqoopTM – InfiniDB Actual error

Sqoop for InfiniDB uses the cpimport utility on each Data node to move the data into InfiniDB in as local a way as possible. What this error is telling us is that some of the row data doesn't fit the data schema. You can maybe find more info if you can find the .err and .bad files on each datanode. They may be found (I think) in /usr/local/Calpont/data/bulk/log (adjust for nonstandard installs). I'll try to get time to run a test later. Maybe I can shed some more light. Let me know if this helps.

dhall@infinidb.co
dhall@infinidb.co's picture
Offline
Last seen: 2 months 2 days ago
Joined: Jul 19 2014
Junior Boarder

Posts: 2

David Hall , Engineer
Gender: Male
Apache SqoopTM – InfiniDBApache SqoopTM – InfiniDB Actual error

Sqoop for InfiniDB uses the cpimport utility on each Data node to move the data into InfiniDB in as local a way as possible. What this error is telling us is that some of the row data doesn't fit the data schema. You can maybe find more info if you can find the .err and .bad files on each datanode. They may be found (I think) in /usr/local/Calpont/data/bulk/log (adjust for nonstandard installs). I'll try to get time to run a test later. Maybe I can shed some more light. Let me know if this helps.