I can store a few thousands of entities incrementally in Development
Server environment using the method below.
public void add(List<String> iriList, List<String> nameList,
List<String> imageList) {
int counter = 0;
ArrayList<Entity> eList = new ArrayList<Entity>();
for (int index=0; index<iriList.size(); index++) {
Entity e = createEntity(iriList.get(index),
nameList.get(index),
imageList.get(index)); // e should be less than 1,000 bytes each
eList.add(e);
counter++; // Break down the storing to DS_LIMIT each
due to
Google limitation/quotas
if ((counter % CUtility.DS_LIMIT) == 0) { // DS_LIMIT
= 200
logger.info("Storing " +
Integer.toString(counter) + " IRIs.");
datastore.put(eList); // Store in
batch
eList = new ArrayList<Entity>(); //
Reset the array
} // if
} // for
if (eList.size() > 0)
datastore.put(eList); // Store in batch
logger.info("Storing " + Integer.toString(counter) + " IRIs.");
}
But when using it in deployed environment, it can only store 1,000
entities. It never adds beyond it. It does not hit the 30-second
limitation because I call it incrementally. After having 1,000
entities, I tried to add more. Below is the log from the deployed
server and verified it stored additional 225 entities without throwing
any exception.
I 10-30 11:38AM 02.852 com.col.server.tool.DsWriter writeIri: Writing
225 to MDsIri
I 10-30 11:38AM 02.867 com.col.server.MDsIri add: Storing 200 IRIs.
I 10-30 11:38AM 04.551 com.col.server.MDsIri add: Storing 225 IRIs.
I 10-30 11:38AM 04.551 com.col.server.tool.DsWriter writeIri:
Done ****************************************
Do I have to do something differently in deployed environment? Any
configuration changes or something? What did I do wrong? I know some
people have stored millions of entities successfully.
Thanks in advance for your help.
--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups
"Google App Engine for Java" group.
To post to this group, send email to [email protected]
To unsubscribe from this group, send email to
[email protected]
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en
-~----------~----~----~----~------~----~------~--~---
