That's the normal behavior, during a commit on a writer. The commit time
is configurable but occurs every 60 seconds (I think) by default.
The rolling operation works as follows:
Commit the writer.
If successful (no exceptions)
sync the Write Ahead Log (WAL)
Delete the old log
Create a new log
On Thu, May 23, 2013 at 1:35 PM, Rahul Challapalli (JIRA)
<[email protected]>wrote:
>
> [
> https://issues.apache.org/jira/browse/BLUR-93?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13665385#comment-13665385]
>
> Rahul Challapalli commented on BLUR-93:
> ---------------------------------------
>
> TableAdmin.createTable method completes successfully but after that I get
> the below messages in my console(they keep going infinitely) and when I
> stop the program in eclipse it also kills the Blur process. Don't know if
> it is an issue with my configuration or a problem in code
>
> INFO 20130522_18:53:29:029_PDT [Commit Thread [words1/shard-00000000]]
> writer.TransactionRecorder: Commit took [11.043 ms] for
> [words1/shard-00000000]
> INFO 20130522_18:53:29:029_PDT [Commit Thread [words1/shard-00000000]]
> writer.TransactionRecorder: Rolling WAL path
> [hdfs://localhost:9000/blur/tables/words/logs/shard-00000000]
> INFO 20130522_18:53:29:029_PDT [Commit Thread [words1/shard-00000000]]
> writer.TransactionRecorder: Log roller took [9.284 ms] for
> [words1/shard-00000000]
>
>
> > A bug was created in the transaction log reported on mail list
> > --------------------------------------------------------------
> >
> > Key: BLUR-93
> > URL: https://issues.apache.org/jira/browse/BLUR-93
> > Project: Apache Blur
> > Issue Type: Bug
> > Affects Versions: 0.1.5
> > Reporter: Aaron McCurry
> > Fix For: 0.1.5
> >
> >
> > Getting the below error while creating a Table in blur. Any ideas?
> > INFO 20130519_20:08:05:005_PDT [Commit Thread [words/shard-00000000]]
> > writer.TransactionRecorder: Log roller took [52.565] for [IndexWriter
> with
> > directory [HdfsDirectory
> > path=[hdfs://localhost:9000/blur/tables/words/shard-00000000]]]
> > INFO 20130519_20:08:08:008_PDT [thrift-processors5]
> > server.ShardServerEventHandler: Method called
> > INFO 20130519_20:08:08:008_PDT [thrift-processors0] thrift.TableAdmin:
> > Opening - Shards Open [1], Shards Opening [0] of table [words]
> > INFO 20130519_20:09:05:005_PDT [Commit Thread [words/shard-00000000]]
> > writer.TransactionRecorder: Commit took [5.219] for [IndexWriter with
> > directory [HdfsDirectory
> > path=[hdfs://localhost:9000/blur/tables/words/shard-00000000]]]
> > INFO 20130519_20:09:05:005_PDT [Commit Thread [words/shard-00000000]]
> > writer.TransactionRecorder: Rolling WAL path
> > [hdfs://localhost:9000/blur/tables/words/logs/shard-00000000]
> > INFO 20130519_20:09:05:005_PDT [Commit Thread [words/shard-00000000]]
> > writer.TransactionRecorder: Log roller took [7.706] for [IndexWriter with
> > directory [HdfsDirectory
> > path=[hdfs://localhost:9000/blur/tables/words/shard-00000000]]]
> > INFO 20130519_20:10:05:005_PDT [Commit Thread [words/shard-00000000]]
> > writer.TransactionRecorder: Commit took [5.394] for [IndexWriter with
> > directory [HdfsDirectory
> > path=[hdfs://localhost:9000/blur/tables/words/shard-00000000]]]
> > INFO 20130519_20:10:05:005_PDT [Commit Thread [words/shard-00000000]]
> > writer.TransactionRecorder: Rolling WAL path
> > [hdfs://localhost:9000/blur/tables/words/logs/shard-00000000]
> > ERROR 20130519_20:10:05:005_PDT [wal-sync-[words/shard-00000000]]
> > writer.TransactionRecorder: Known error while trying to sync.
> > java.io.IOException: DFSOutputStream is closed
> > at
> >
> org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.sync(DFSClient.java:3669)
> > at
> org.apache.hadoop.fs.FSDataOutputStream.sync(FSDataOutputStream.java:97)
> > at
> >
> org.apache.blur.manager.writer.TransactionRecorder.tryToSync(TransactionRecorder.java:301)
> > at
> >
> org.apache.blur.manager.writer.TransactionRecorder.tryToSync(TransactionRecorder.java:291)
> > at
> >
> org.apache.blur.manager.writer.TransactionRecorder.run(TransactionRecorder.java:380)
>
> --
> This message is automatically generated by JIRA.
> If you think it was sent incorrectly, please contact your JIRA
> administrators
> For more information on JIRA, see: http://www.atlassian.com/software/jira
>