[ 
https://issues.apache.org/jira/browse/ASTERIXDB-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863663#comment-17863663
 ] 

ASF subversion and git services commented on ASTERIXDB-3453:
------------------------------------------------------------

Commit 49824f58b68dd6621ba41754e8e07d1cab356c70 in asterixdb's branch 
refs/heads/master from Wail Alkowaileet
[ https://gitbox.apache.org/repos/asf?p=asterixdb.git;h=49824f58b6 ]

[ASTERIXDB-3453][STO] Incompressible pages are not written as full pages

- user model changes: no
- storage format changes: no
- interface changes: yes

Details:
Incompressible pages must be written as full pages (i.e., as
page + header) entirely to ensure the position of the cloud
files are in-sync with local files.

Change-Id: Iccebe6fcab375d064825ab2e9343b96daf8afbc6
Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/18446
Integration-Tests: Jenkins <[email protected]>
Reviewed-by: Wail Alkowaileet <[email protected]>
Reviewed-by: Murtadha Hubail <[email protected]>
Tested-by: Jenkins <[email protected]>


> Incompressible pages are not written as full pages
> --------------------------------------------------
>
>                 Key: ASTERIXDB-3453
>                 URL: https://issues.apache.org/jira/browse/ASTERIXDB-3453
>             Project: Apache AsterixDB
>          Issue Type: Bug
>          Components: STO - Storage
>    Affects Versions: 0.9.10
>            Reporter: Wail Y. Alkowaileet
>            Assignee: Wail Y. Alkowaileet
>            Priority: Blocker
>             Fix For: 0.9.10
>
>
> Incompressible pages are not written entirely. Although this won't impose an 
> issue in a non-cloud deployment, but in a cloud deployment, this would mess 
> up the file. The reason is that, in a cloud deployment, writes are 
> "append-only". That means, writes' offsets cannot be used to determine the 
> write position.
> Thus, if an incompressible page is written and the size of the page is 
> smaller than a full page, this could write this page's content at the wrong 
> position in the cloud storage – leading to have more bytes in local files 
> than in the cloud.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to