Adding shards at runtime

Sometime a user wants to add a shard (i.e., go from 3 shards to 4). What is the process? Clients need to re-connect to all 4 shards — close the DistibutedEngine that is connected to 3 shards and reconnect to 4. The moving/rebalancing of the data is the application’s responsibility. There is no right way of redistributing data across shards this at the moment. Essentially its necessary to pull data to the client and redistribute from the client

The first approach is to use a file to read the data to:

• Start xsqlcmd

XSQLCMD> format CSV
XSQLCMD> output mytable.csv
SELECT * FROM MYTABLE

• Copy mytable.csv to all shards and
  

  INSERT INTO MYTABLE from select * from foreign table (path='mytable.csv') where ...