Joe McDonnell has submitted this change and it was merged. ( 
http://gerrit.cloudera.org:8080/23602 )

Change subject: IMPALA-14514: Handle serializing bytes in bin/run-workload.py
......................................................................

IMPALA-14514: Handle serializing bytes in bin/run-workload.py

On python 3, when Impyla receives a result with a string that is
not valid UTF-8, it returns that as bytes. TPC-DS Q30 on scale 20
has a result that contains invalid UTF-8, so bin/run-workload.py
can fail while trying to dump this to JSON.

This modifies CustomJSONEncoder to handle serializing bytes by
converting it to a string with invalid unicode handled with
backslashes.

Testing:
 - Ran bin/run-workload.py against TPC-DS scale 20

Change-Id: Ibe31c656de4fc65f8580c7b3b49bf655b8a5ecea
Reviewed-on: http://gerrit.cloudera.org:8080/23602
Reviewed-by: Riza Suminto <[email protected]>
Reviewed-by: Jason Fehr <[email protected]>
Tested-by: Joe McDonnell <[email protected]>
---
M bin/run-workload.py
1 file changed, 5 insertions(+), 0 deletions(-)

Approvals:
  Riza Suminto: Looks good to me, but someone else must approve
  Jason Fehr: Looks good to me, approved
  Joe McDonnell: Verified

--
To view, visit http://gerrit.cloudera.org:8080/23602
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: merged
Gerrit-Change-Id: Ibe31c656de4fc65f8580c7b3b49bf655b8a5ecea
Gerrit-Change-Number: 23602
Gerrit-PatchSet: 3
Gerrit-Owner: Joe McDonnell <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Jason Fehr <[email protected]>
Gerrit-Reviewer: Joe McDonnell <[email protected]>
Gerrit-Reviewer: Riza Suminto <[email protected]>

Reply via email to