Could you please share your benchmark code? I believe compression might depend on data you write, if it full random, it's difficult to compress the data.
On Wed, Aug 26, 2020, 8:26 PM 38797715 <[email protected]> wrote: > Hi, > > We turn on disk compression to see the trend of execution time and disk > space. > > Our expectation is that after disk compression is turned on, although more > CPU is used, the disk space is less occupied. Because more data is written > per unit time, the overall execution time will be shortened in the case of > insufficient memory. > > However, it is found that the execution time and disk consumption do not > change significantly. We tested the diskPageCompressionLevel values as 0, > 10 and 17 respectively. > > Our test method is as follows: > The ignite-compress module has been introduced. > > The configuration of ignite is as follows: > <?xml version="1.0" encoding="UTF-8"?> > <beans xmlns="http://www.springframework.org/schema/beans"; > <http://www.springframework.org/schema/beans> > xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; > <http://www.w3.org/2001/XMLSchema-instance> xsi:schemaLocation=" > http://www.springframework.org/schema/beans > http://www.springframework.org/schema/beans/spring-beans.xsd";> > <bean id="ignite.cfg" class= > "org.apache.ignite.configuration.IgniteConfiguration"> > <property name="peerClassLoadingEnabled" value="true"/> > <property name="consistentId" value="b"/> > <property name="igniteInstanceName" value="ClusterName1"/> > <property name="workDirectory" value="/home/ignite"/> > <property name="gridLogger"> > <bean class="org.apache.ignite.logger.log4j2.Log4J2Logger"> > <constructor-arg type="java.lang.String" value="config/ignite-log4j2.xml" > /> > </bean> > </property> > <property name="cacheConfiguration"> > <list> > <bean id="partitioned-cache-template" abstract="true" class= > "org.apache.ignite.configuration.CacheConfiguration"> > <property name="name" value="cache-partitioned*"/> > <property name="cacheMode" value="PARTITIONED" /> > <property name="queryParallelism" value="2"/> > <property name="diskPageCompression" value="LZ4"/> > <property name="diskPageCompressionLevel" value="17"/> > </bean> > </list> > </property> > <!-- Enabling Apache Ignite Persistent Store. --> > <property name="dataStorageConfiguration"> > <bean class="org.apache.ignite.configuration.DataStorageConfiguration"> > <property name="pageSize" value="#{4096 * 2}"/> > <property name="defaultDataRegionConfiguration"> > <bean class="org.apache.ignite.configuration.DataRegionConfiguration"> > <property name="persistenceEnabled" value="true"/> > <property name="maxSize" value="#{1L * 1024 * 1024 * 1024}"/> > </bean> > </property> > </bean> > </property> > </bean> > </beans> >
