Disk usage - tables more than 8 million records

2 posts / 0 new
Last post
nidhks
nidhks's picture
Offline
Last seen: 5 months 2 weeks ago
Joined: Jan 31 2014
Junior Boarder

Posts: 1

nidheesh ks
Disk usage - tables more than 8 million records

From another post i got the details how infiniDB allocates disk space for dictionary and non-dictionary column

"Non-dictionary columns are set to the 8 million row size when they exceed 256K rows. Dictionary columns will grow as needed, 64 MB at a time."

So for Non-dictionary columns if number of records are less than 8 million, it will allocate disk size for 8 million rows. What will happed if actual number of size exceeds 8 million rows?

radams
radams's picture
Offline
Last seen: 1 day 15 hours ago
Joined: Jan 3 2011
Administrator

Posts: 492

Robert Adams
Disk usage - tables more than 8 million records

Hi,

When InfiniDB builds out tables, we want to ensure that records are located together on disk and avoid fragmented files.

So, as tables grow:
0-256k rows  . we allocate enough for 256k rows.
between 256k and 8 million ... we allocate enough for 8 million rows.
beyond 8 million - add another allocation big enough for 8 million rows.
beyond 16 million - add another allocation big enough for 8 million rows.
...

Hope this helps,
Cheers,
Jim