Changes between Version 7 and Version 8 of Performance


Ignore:
Timestamp:
Jun 16, 2013, 9:53:38 PM (11 years ago)
Author:
Dimitar Misev
Comment:

Legend:

Unmodified
Added
Removed
Modified
  • Performance

    v7 v8  
    2424|| 0:31,0:31,0:149 || 460800 || 35 minutes || 184M || '''19416M''' || 267 MB || 18 GB ||
    2525
    26  * Using [#TileCache tile cache]
     26 * Using [#Tilecache tile cache]
    2727   
    2828|| '''Tiling scheme''' || '''Tile size''' || '''Import time''' || '''DB size before''' || '''DB size after''' || '''BLOBs size''' || '''BLOBs size2''' ||
     
    104104A tile cache can be enabled in rasdaman during bulk ingestion, in order to work around inefficiencies of BLOB handling in postgres and slow performance for certain tiling schemes.
    105105
    106 '''IMPORTANT:''' At the moment the tile cache should be used during bulk ingestion '''_ONLY_''', and disabled afterwards. Leaving the tile cache on will cause selection queries to fail randomly. Furthermore, it is best to have only one server defined in rasmgr.conf, and `-countdown` and `--timeout` parameters set to very large values.
     106== How to use ==
    107107
    108108The cache can be enabled in rasmgr.conf by specifying a `--cachelimit` parameter after the `-xp` parameter:
     
    120120change srv N1 -countdown 20000000 -autorestart on -xp --timeout 30000000 --cachelimit 1073741824
    121121}}}
     122
     123When enabled, `INSERT` and `UPDATE` rasql statements can be issued in the normal way. At the end of the ingestion a `COMMIT` command should be executed, to make sure that the cache is cleared and everything is flushed to disk. E.g.
     124{{{
     125rasql -q 'insert into coll ...'
     126rasql -q 'update coll ...'
     127rasql -q 'update coll ...'
     128rasql -q 'update coll ...'
     129
     130# done with ingestion
     131rasql -q 'commit'
     132}}}
     133
     134== Important limitation ==
     135
     136At the moment the tile cache should be used during bulk ingestion '''_ONLY_''', and disabled afterwards. Leaving the tile cache on will cause selection queries to fail randomly. Furthermore, it is best to have only one server defined in rasmgr.conf, and `-countdown` and `--timeout` parameters set to very large values.