s.chunkSize = *directArenas[0].chunkSize;*
if (memoryLogger.isTraceEnabled()) {
statusThread = new MemoryStatusThread();
statusThread.start();
}}
Is this known issue in Spark test suite ArrowUtilSuite?
--
Senthil kumar
Congratulations Yikun
On Mon, 10 Oct 2022, 09:11 Xiao Li, wrote:
> Congratulations, Yikun!
>
> Xiao
>
> Yikun Jiang 于2022年10月9日周日 19:34写道：
>
>> Thank you all!
>>
>> Regards,
>> Yikun
>>
>>
>> On Mon, Oct 10, 2022 at 3:18 AM Chao Sun wrote:
>>
>>> Congratulations Yikun!
>>>
>>> On Sun, Oct 9,
es) {
>
> println(s"Creating temporary view $t")
>
> spark.read.parquet(path + t).createOrReplaceTempView(t)
>
> }
>
>
>
> val q4="""…"""
>
> // SQL from
> https://github.com/databricks/spark-sql-perf/blob/master/src/m
Also we checked that we have already backported
https://issues.apache.org/jira/browse/SPARK-33557 jira.
On Mon, Dec 20, 2021 at 11:08 AM Senthil Kumar wrote:
> @abhishek. We use spark 3.1*
>
> On Mon, 20 Dec 2021, 09:50 Rao, Abhishek (Nokia - IN/Bangalore), <
> abhishek@n
out, this was resulting in TPCDS
> queries taking long time when tried with Spark 3.0.2 and 3.1.x. Once we
> corrected it, we observed that the queries were executed much faster.
>
>
>
> Thanks and Regards,
>
> Abhishek
>
>
>
> *From:* Senthil Kumar
> *Sent:* Su
input on what could be the
reason behind this poor performance.
--
Senthil kumar
nce Spark, etc.):
>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9>
>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau
>>
>
--
Senthil kumar
Hi All , We are using Spark 1.6 Version R library .. Below is our code
which Loads the THIRD Party Library .
library("BreakoutDetection", lib.loc = "*hdfs://xx/BreakoutDetection/*")
:
library("BreakoutDetection", lib.loc = "*//xx/BreakoutDetection/*") :
When i try to execute the code
Hi All , I have a requirement to Process huge file ( 75 GB ) ..
Here is the sample data :
100
spark.conf
.
.
.
99989796
Steps :
