Hi Navina, I did indeed came across the long thread dealing with this. And yes, things were working fine after the rocksdb upgrade to 3.13.1 which I'm still using. Not sure what I changed that's causing this. I did merge latest from upstream into my repo as well as exposed some RocksDb config though the failing jobs are not using.
I'm using Red Hat Enterprise Linux 6.6 (gcc 4.4) and Oracle Java 8. Did open a JIRA: https://issues.apache.org/jira/browse/SAMZA-870 Edi On Mon, Feb 8, 2016 at 1:05 PM, Navina Ramesh <nram...@linkedin.com.invalid> wrote: > Hi Edi, > I have seen this issue only before the rocksdb upgrade when the build was > running on Linux boxes. > > What OS are you running on? And can you confirm the rocksdb version? > > If you are running on Linux with the correct version of rocksdb, please > open a JIRA ticket. I will try to reproduce on my end. > > Thanks! > Navina > > On Mon, Feb 8, 2016 at 6:33 AM, Edi Bice <edi.b...@gmail.com> wrote: > > > I'm running the latest master with a small patch of mine allowing for > > additional RocksDb config options. I deleted ~/.m2 and gradle cache to > > avoid some issues I was running into. After rebuilding Samza, I'm getting > > the following exception on all my jobs: > > > > org.apache.samza.SamzaException: Error opening RocksDB store > > xxx/Partition_6, received the following exception from RocksDB > > org.rocksdb.RocksDBException: Invalid argument: Compression type Snappy > is > > not linked with the binary. > > at > > > > > org.apache.samza.storage.kv.RocksDbKeyValueStore$.openDB(RocksDbKeyValueStore.scala:81) > > at > > > > > org.apache.samza.storage.kv.RocksDbKeyValueStore.db$lzycompute(RocksDbKeyValueStore.scala:103) > > at > > > > > org.apache.samza.storage.kv.RocksDbKeyValueStore.db(RocksDbKeyValueStore.scala:103) > > at > > > > > org.apache.samza.storage.kv.RocksDbKeyValueStore.flush(RocksDbKeyValueStore.scala:195) > > at > > org.apache.samza.storage.kv.LoggedStore.flush(LoggedStore.scala:107) > > at > > > > > org.apache.samza.storage.kv.SerializedKeyValueStore.flush(SerializedKeyValueStore.scala:117) > > at > > org.apache.samza.storage.kv.CachedStore.flush(CachedStore.scala:194) > > at > > > > > org.apache.samza.storage.kv.NullSafeKeyValueStore.flush(NullSafeKeyValueStore.scala:82) > > at > > > > > org.apache.samza.storage.kv.KeyValueStorageEngine.flush(KeyValueStorageEngine.scala:123) > > at > > > > > org.apache.samza.storage.kv.KeyValueStorageEngine.close(KeyValueStorageEngine.scala:135) > > at > > > > > org.apache.samza.storage.kv.KeyValueStorageEngine.stop(KeyValueStorageEngine.scala:129) > > at > > > > > org.apache.samza.storage.TaskStorageManager$$anonfun$stopStores$2.apply(TaskStorageManager.scala:193) > > at > > > > > org.apache.samza.storage.TaskStorageManager$$anonfun$stopStores$2.apply(TaskStorageManager.scala:193) > > at scala.collection.Iterator$class.foreach(Iterator.scala:727) > > at scala.collection.AbstractIterator.foreach(Iterator.scala:1157) > > at > > scala.collection.MapLike$DefaultValuesIterable.foreach(MapLike.scala:206) > > at > > > > > org.apache.samza.storage.TaskStorageManager.stopStores(TaskStorageManager.scala:193) > > at > > > > > org.apache.samza.storage.TaskStorageManager.stop(TaskStorageManager.scala:197) > > at > > > > > org.apache.samza.container.TaskInstance.shutdownStores(TaskInstance.scala:203) > > at > > > > > org.apache.samza.container.SamzaContainer$$anonfun$shutdownStores$2.apply(SamzaContainer.scala:689) > > at > > > > > org.apache.samza.container.SamzaContainer$$anonfun$shutdownStores$2.apply(SamzaContainer.scala:689) > > at scala.collection.Iterator$class.foreach(Iterator.scala:727) > > at scala.collection.AbstractIterator.foreach(Iterator.scala:1157) > > at > > scala.collection.MapLike$DefaultValuesIterable.foreach(MapLike.scala:206) > > at > > > > > org.apache.samza.container.SamzaContainer.shutdownStores(SamzaContainer.scala:689) > > at > > org.apache.samza.container.SamzaContainer.run(SamzaContainer.scala:568) > > at > > > > > org.apache.samza.container.SamzaContainer$.safeMain(SamzaContainer.scala:93) > > at > > org.apache.samza.container.SamzaContainer$.main(SamzaContainer.scala:67) > > at > > org.apache.samza.container.SamzaContainer.main(SamzaContainer.scala) > > > > > > -- > Navina R. >
