Re: [edk2-devel] [PATCH] BaseTools:Fix the library dependency missing in Binary Cache

2019-05-28 Thread Christian Rodriguez
dule in the build scheduler and the module build fails if cache miss >happen. > >Cc: Liming Gao >Cc: Bob Feng >Cc: Christian Rodriguez >Signed-off-by: Steven Shi >--- > BaseTools/Source/Python/build/build.py | 2 +- > 1 file changed, 1 insertion(+), 1 deletion(-) > &

Re: [edk2-devel] [PATCH] BaseTools:Extend the binary cache to support library cache

2019-05-28 Thread Christian Rodriguez
ebuild which >is very time-consuming. This patch is to entend the binary >cache to support library. > >Cc: Liming Gao >Cc: Bob Feng >Cc: Christian Rodriguez >Signed-off-by: Steven Shi >--- > BaseTools/Source/Python/AutoGen/AutoGen.py | 17 ++--- > BaseTools/So

[edk2-devel] [Patch V4 0/2] BaseTools: Add a checking for Sources section and update hashing feature

2019-05-29 Thread Christian Rodriguez
ra IO time is needed. Christian Rodriguez (2): BaseTools: Add a checking for Sources section in INF file BaseTools: Refactor hash tracking after checking for Sources section BaseTools/Source/Python/AutoGen/AutoGen.py | 6 +- BaseTools/Source/Python/AutoGen/GenMake.py | 44 +

[edk2-devel] [Patch V4 2/2] BaseTools: Refactor hash tracking after checking for Sources section

2019-05-29 Thread Christian Rodriguez
on that library or module. Signed-off-by: Christian Rodriguez Cc: Bob Feng Cc: Liming Gao Cc: Yonghong Zhu --- BaseTools/Source/Python/AutoGen/AutoGen.py | 6 +- BaseTools/Source/Python/AutoGen/GenMake.py | 6 ++ BaseTools/Source/Python/Common/GlobalData.py | 3 +- BaseTools/Source/Python/build

[edk2-devel] [Patch V4 1/2] BaseTools: Add a checking for Sources section in INF file

2019-05-29 Thread Christian Rodriguez
cached in memory. No extra IO time is needed. Signed-off-by: Christian Rodriguez Cc: Bob Feng Cc: Liming Gao Cc: Yonghong Zhu --- BaseTools/Source/Python/AutoGen/GenMake.py | 38 1 file changed, 38 insertions(+) diff --git a/BaseTools/Source/Python/AutoGen/GenMake.py b

Re: [edk2-devel] Edk2 BaseTools Patches.

2019-05-30 Thread Christian Rodriguez
Hey Leif, I thought I'd help Bob and gather those BZs for each thread: [Patch V4 1/2] BaseTools: Add a checking for Sources section in INF file [Patch V4 2/2] BaseTools: Refactor hash tracking after checking for Sources section BZ: https://bugzilla.tianocore.org/show_bug.cgi?id=1804 [PATCH v3

Re: [edk2-devel] [Patch V3 2/2] BaseTools: Add a checking for Sources section in INF file [Part 2/2]

2019-05-29 Thread Christian Rodriguez
Please review. Bump. >-Original Message- >From: devel@edk2.groups.io [mailto:devel@edk2.groups.io] On Behalf Of >Christian Rodriguez >Sent: Friday, May 24, 2019 7:40 AM >To: devel@edk2.groups.io >Cc: Feng, Bob C ; Gao, Liming >; Zhu, Yonghong >Subject: [e

Re: [edk2-devel] [Patch V3 1/2] BaseTools: Add a checking for Sources section in INF file [Part 1/2]

2019-05-29 Thread Christian Rodriguez
Please review. Bump. >-Original Message- >From: devel@edk2.groups.io [mailto:devel@edk2.groups.io] On Behalf Of >Christian Rodriguez >Sent: Friday, May 24, 2019 7:40 AM >To: devel@edk2.groups.io >Cc: Feng, Bob C ; Gao, Liming >; Zhu, Yonghong >Subject: [e

Re: [edk2-devel] [Patch V3] OpensslLib: Missing local header files in [Sources] section of .INFs

2019-06-06 Thread Christian Rodriguez
Hi Xiaoyu, For your comment (1), I don't see a way to rule out headers using configdata. I was already using configdata to get the include directories, but configdata doesn't list the specific header files that will be used for compilation. We can ignore things with a common name or specific

Re: [edk2-devel] Edk2 BaseTools Patches.

2019-05-30 Thread Christian Rodriguez
See below. >-Original Message- >From: Leif Lindholm [mailto:leif.lindh...@linaro.org] >Sent: Thursday, May 30, 2019 9:38 AM >To: Feng, Bob C >Cc: Rodriguez, Christian ; Andrew Fish >; Laszlo Ersek ; Kinney, Michael D >; devel@edk2.groups.io; Gao, Liming >; Shi, Steven ; Fan, ZhijuX >

Re: [edk2-devel] [PATCH] BaseTools: Cannot store library cache of different arch together

2019-06-12 Thread Christian Rodriguez
is why the Basetool can only store one arch cache > >for > >library. > >This patch avoid to use the set() as the container to save the library and > >module objects because the objects might have same __hash__ value. > > > >Cc: Liming Gao mailto:liming@intel.c

Re: [edk2-devel] [PATCH] BaseTools: Include headers not mentioned in inf are not hashed

2019-05-10 Thread Christian Rodriguez
users of the hash feature to be UEFI spec complaint. What do you guys think; Laszlo and Felix? I'll update the BZ when I get your input. Thanks, Christian Rodriguez >-Original Message- >From: devel@edk2.groups.io [mailto:devel@edk2.groups.io] On Behalf Of >Felix Polyudov >Sent:

[edk2-devel] [PATCH] BaseTools: Include headers not mentioned in inf are not hashed

2019-05-09 Thread Christian Rodriguez
correctly though the hashing system didn't know about it before. Signed-off-by: Christian Rodriguez Cc: Bob Feng Cc: Liming Gao Cc: Yonghong Zhu --- BaseTools/Source/Python/AutoGen/AutoGen.py | 24 1 file changed, 24 insertions(+) diff --git a/BaseTools/Source/Python

Re: [edk2-devel] [PATCH] BaseTools: Include headers not mentioned in inf are not hashed

2019-05-10 Thread Christian Rodriguez
om this >feature to cause the build to break when the hash feature is enabled. This >would force users of the hash feature to be UEFI spec complaint. >> >> What do you guys think; Laszlo and Felix? >> >> I'll update the BZ when I get your input. >> >> T

Re: [edk2-devel] [PATCH] BaseTools: Include headers not mentioned in inf are not hashed

2019-05-13 Thread Christian Rodriguez
>>>> After talking to my colleagues about this, the direction seems to be >>>> to fundamentally change this BZ. Instead of building this sort of >>>> workaround feature, we should use the information gathered from this >>> feature to cause the build to brea

Re: [edk2-devel] [PATCH] BaseTools: Include headers not mentioned in inf are not hashed

2019-05-13 Thread Christian Rodriguez
>>>> to fundamentally change this BZ. Instead of building this sort of >>>> workaround feature, we should use the information gathered from this >>> feature to cause the build to break when the hash feature is enabled. >>> This would force users of t

Re: [edk2-devel] [PATCH] BaseTools: Include headers not mentioned in inf are not hashed

2019-05-13 Thread Christian Rodriguez
Gao, Liming >; Zhu, Yonghong >Subject: Re: [edk2-devel] [PATCH] BaseTools: Include headers not mentioned >in inf are not hashed > >On 05/13/19 20:53, Christian Rodriguez wrote: >> I think a warning would be reasonable. >> >> I only mention the spec because it r

Re: [edk2-devel] [PATCH] BaseTools: Include headers not mentioned in inf are not hashed

2019-05-13 Thread Christian Rodriguez
l@edk2.groups.io [mailto:devel@edk2.groups.io] On Behalf Of >Christian Rodriguez >Sent: Monday, May 13, 2019 11:54 AM >To: Laszlo Ersek ; devel@edk2.groups.io; >fel...@ami.com >Cc: Feng, Bob C ; Gao, Liming >; Zhu, Yonghong >Subject: Re: [edk2-devel] [PATCH] BaseTools: Include he

Re: [edk2-devel] [Patch V3] OpensslLib: Missing local header files in [Sources] section of .INFs

2019-05-22 Thread Christian Rodriguez
; (3) I think it's better to separate this patch into two. >>Patch1. process_files.pl >>Patch2. OpensslLib[Crypto].conf >> >>> -Original Message- >>> From: devel@edk2.groups.io [mailto:devel@edk2.groups.io] On Behalf Of >>> Christian Rodriguez

Re: [edk2-devel] [PATCH] BaseTools: Add a checking for Sources section in INF file

2019-05-23 Thread Christian Rodriguez
ink the condition of this check >should be removed. >Would you show the build time to see what's the performance impact if we >always do this check? > >Thanks, >Bob > >-Original Message- >From: devel@edk2.groups.io [mailto:devel@edk2.groups.io] On Behalf Of >Chri

Re: [edk2-devel] [Patch V2] BaseTools: Add a checking for Sources section in INF file

2019-05-23 Thread Christian Rodriguez
, Christian >-Original Message- >From: devel@edk2.groups.io [mailto:devel@edk2.groups.io] On Behalf Of >Christian Rodriguez >Sent: Thursday, May 23, 2019 9:06 AM >To: devel@edk2.groups.io >Cc: Feng, Bob C ; Gao, Liming >; Zhu, Yonghong >Subject: [edk2-devel] [Patch V2] B

[edk2-devel] [Patch V2] BaseTools: Add a checking for Sources section in INF file

2019-05-23 Thread Christian Rodriguez
ource" type files of a module. Performance impact should be minimal with this patch since information is already being fetched for Makefile purposes. All other information is already cached in memory. No extra IO time is needed. Signed-off-by: Christian Rodriguez Cc: Bob Feng Cc: Liming Gao Cc

[edk2-devel] [Patch V3 0/2] BaseTools: Add a checking for Sources section in INF file [Part 0/2]

2019-05-24 Thread Christian Rodriguez
All other information is already cached in memory. No extra IO time is needed. Christian Rodriguez (2): BaseTools: Add a checking for Sources section in INF file [Part 1/2] BaseTools: Add a checking for Sources section in INF file [Part 2/2] BaseTools/Source/Python/AutoGen/AutoGen.py | 6 +-

[edk2-devel] [Patch V3 2/2] BaseTools: Add a checking for Sources section in INF file [Part 2/2]

2019-05-24 Thread Christian Rodriguez
is hashing update. Signed-off-by: Christian Rodriguez Cc: Bob Feng Cc: Liming Gao Cc: Yonghong Zhu --- BaseTools/Source/Python/AutoGen/AutoGen.py | 6 +- BaseTools/Source/Python/AutoGen/GenMake.py | 6 ++ BaseTools/Source/Python/Common/GlobalData.py | 3 +- BaseTools/Source/Python/buil

[edk2-devel] [Patch V3 1/2] BaseTools: Add a checking for Sources section in INF file [Part 1/2]

2019-05-24 Thread Christian Rodriguez
is checker only. Signed-off-by: Christian Rodriguez Cc: Bob Feng Cc: Liming Gao Cc: Yonghong Zhu --- BaseTools/Source/Python/AutoGen/GenMake.py | 38 1 file changed, 38 insertions(+) diff --git a/BaseTools/Source/Python/AutoGen/GenMake.py b/BaseTools/Source/Python/AutoGen/

[edk2-devel] [Patch V3] BaseTools: Library hashing fix and optimization for --hash feature

2019-05-20 Thread Christian Rodriguez
. Added early escape as optimization, if hash already exists in memory. Signed-off-by: Christian Rodriguez Cc: Bob Feng Cc: Liming Gao Cc: Yonghong Zhu --- BaseTools/Source/Python/AutoGen/AutoGen.py | 53 - BaseTools/Source/Python/Common

[edk2-devel] [Patch V2 3/4] BaseTools: Fix corner-cases of --hash feature

2019-04-04 Thread Christian Rodriguez
BZ: https://bugzilla.tianocore.org/show_bug.cgi?id=1680 Respect artifact location within directory structure. Contributed-under: TianoCore Contribution Agreement 1.1 Signed-off-by: Christian Rodriguez Cc: Bob Feng Cc: Liming Gao Cc: Yonghong Zhu --- BaseTools/Source/Python/AutoGen

[edk2-devel] [Patch V2 1/4] BaseTools: Fix corner-cases of --hash feature

2019-04-04 Thread Christian Rodriguez
BZ: https://bugzilla.tianocore.org/show_bug.cgi?id=1680 Consider modules with .inc source files as Binary Modules and do not Skip by hash. Contributed-under: TianoCore Contribution Agreement 1.1 Signed-off-by: Christian Rodriguez Cc: Bob Feng Cc: Liming Gao Cc: Yonghong Zhu --- BaseTools

[edk2-devel] [Patch V2 2/4] BaseTools: Fix corner-cases of --hash feature

2019-04-04 Thread Christian Rodriguez
BZ: https://bugzilla.tianocore.org/show_bug.cgi?id=1680 Re-order hashing operations so we don't do redundant hashes. Contributed-under: TianoCore Contribution Agreement 1.1 Signed-off-by: Christian Rodriguez Cc: Bob Feng Cc: Liming Gao Cc: Yonghong Zhu --- BaseTools/Source/Python/AutoGen

[edk2-devel] [Patch V2 0/4] BaseTools: Fix corner-cases of --hash feature

2019-04-04 Thread Christian Rodriguez
. Christian Rodriguez (4): BaseTools: Fix corner-cases of --hash feature BaseTools: Fix corner-cases of --hash feature BaseTools: Fix corner-cases of --hash feature BaseTools: Fix corner-cases of --hash feature BaseTools/Source/Python/AutoGen/AutoGen.py | 47 +- BaseTools/Source

[edk2-devel] [PATCH] BaseTools: Hash false success with back to back builds

2019-04-10 Thread Christian Rodriguez
BZ: https://bugzilla.tianocore.org/show_bug.cgi?id=1692 Add error handling to the --hash feature so that hash files are invalidated when a build error occurs. Signed-off-by: Christian Rodriguez Cc: Bob Feng Cc: Liming Gao Cc: Yonghong Zhu --- BaseTools/Source/Python/Common/GlobalData.py

[edk2-devel] [PATCH] BaseTools: Hash false success.. minor change in hash invalidation

2019-04-16 Thread Christian Rodriguez
BZ: https://bugzilla.tianocore.org/show_bug.cgi?id=1692 Change part of the hash error handling to invalidate hashes in the cache destination not the cache source. Signed-off-by: Christian Rodriguez Cc: Bob Feng Cc: Liming Gao Cc: Yonghong Zhu --- BaseTools/Source/Python/build/build.py | 4

[edk2-devel] [Patch V2] BaseTools: Enhance Bin Cache database to support save the cache

2019-04-18 Thread Christian Rodriguez
BZ: https://bugzilla.tianocore.org/show_bug.cgi?id=1726 V2: Added the platform name to the path Add more level sub-directories in the database to support save the cache for multiple platforms with multiple tool-chains and targets, just like edk2 Build output. Signed-off-by: Christian Rodriguez

Re: [edk2-devel] [PATCH] BaseTools: Hash false success.. minor change in hash invalidation

2019-04-18 Thread Christian Rodriguez
.groups.io] On Behalf Of Christian Rodriguez Sent: Tuesday, April 16, 2019 12:41 PM To: devel@edk2.groups.io Cc: Feng, Bob C ; Gao, Liming ; Zhu, Yonghong Subject: [edk2-devel] [PATCH] BaseTools: Hash false success.. minor change in hash invalidation BZ: https://bugzilla.tianocore.org/show_bug.cgi

Re: [edk2-devel] [PATCH] BaseTools: Include headers not mentioned in inf are not hashed

2019-05-10 Thread Christian Rodriguez
rs not mentioned >in inf are not hashed > >Some questions inline. > >> -Original Message- >> From: devel@edk2.groups.io [mailto:devel@edk2.groups.io] On Behalf Of >> Christian Rodriguez >> Sent: Thursday, May 09, 2019 2:27 PM >> To: devel@edk2.groups.io >

[edk2-devel] [PATCH] BaseTools: Add a checking for Sources section in INF file

2019-05-21 Thread Christian Rodriguez
be minimal with this patch since information is already being fetched for Makefile purposes. All other information is already cached in memory. No extra IO time is needed. Signed-off-by: Christian Rodriguez Cc: Bob Feng Cc: Liming Gao Cc: Yonghong Zhu --- BaseTools/Source/Python/AutoGen/AutoGen

[edk2-devel] [PATCH] OpensslLib: Missing local header files in [Sources] section of .INFs

2019-05-21 Thread Christian Rodriguez
compilance of Edk2 INF Spec 3.9, which states, All HII Unicode format files must be listed in [Sources] section. Not functional issue, just compilance. Signed-off-by: Christian Rodriguez Cc: Jian Wang Cc: Ting Ye Cc: Yonghong Zhu --- CryptoPkg/Library/OpensslLib/OpensslLib.inf | 174

[edk2-devel] [Patch V3] OpensslLib: Missing local header files in [Sources] section of .INFs

2019-05-21 Thread Christian Rodriguez
OpensslLib.inf and OpensslLibCrypto.inf using the updated script. Enforce compilance of Edk2 INF Spec 3.9, which states, All HII Unicode format files must be listed in [Sources] section. Not functional issue, just compilance. Signed-off-by: Christian Rodriguez Cc: Jian Wang Cc: Ting Ye Cc: Yonghong

[edk2-devel] [PATCH] BaseTools: Library hashing fix and optimization for --hash feature

2019-05-14 Thread Christian Rodriguez
. So on a clean build, we now generate the .hash after the library dependencies are complete. Added early escape as optimization, if hash already exists in memory. Signed-off-by: Christian Rodriguez Cc: Bob Feng Cc: Liming Gao Cc: Yonghong Zhu --- BaseTools/Source/Python/AutoGen/AutoGen.py

[edk2-devel] [Patch V2] BaseTools: Library hashing fix and optimization for --hash feature

2019-05-16 Thread Christian Rodriguez
-by: Christian Rodriguez Cc: Bob Feng Cc: Liming Gao Cc: Yonghong Zhu --- BaseTools/Source/Python/AutoGen/AutoGen.py | 52 +++- BaseTools/Source/Python/Common/GlobalData.py | 6 ++ BaseTools/Source/Python/build/build.py | 7 ++- 3 files

[edk2-devel] [Patch V3] BaseTools: Fix checking for Sources section in INF file

2019-08-12 Thread Christian Rodriguez
BZ: https://bugzilla.tianocore.org/show_bug.cgi?id=1804 The check to see if [Sources] section lists all the header type files of a module is missing the exclusion of source files that fall under the scope of Package includes. This change adds the exclusions. Signed-off-by: Christian Rodriguez

Re: [edk2-devel] [PATCH v4 1/5] BaseTools: Improve the cache hit in the edk2 build cache

2019-08-14 Thread Christian Rodriguez
For all 5 patches in patch set: Acked-by: Christian Rodriguez >-Original Message- >From: Shi, Steven >Sent: Wednesday, August 14, 2019 11:11 AM >To: devel@edk2.groups.io >Cc: Gao, Liming ; Feng, Bob C >; Rodriguez, Christian >; Johnson, Michael >; Shi, Steven

[edk2-devel] [PATCH] BaseTools: Fix checking for Sources section in INF file

2019-07-31 Thread Christian Rodriguez
BZ: https://bugzilla.tianocore.org/show_bug.cgi?id=1804 The check to see if [Sources] section lists all the header type files of a module is missing the exclusion of source files that fall under the scope of Package includes. This change adds the exclusions. Signed-off-by: Christian Rodriguez

Re: [edk2-devel] [Patch V2] BaseTools: Fix checking for Sources section in INF file

2019-08-01 Thread Christian Rodriguez
anks, >Bob > > >-Original Message- >From: devel@edk2.groups.io [mailto:devel@edk2.groups.io] On Behalf Of >Christian Rodriguez >Sent: Thursday, August 1, 2019 11:33 PM >To: devel@edk2.groups.io >Cc: Feng, Bob C ; Gao, Liming > >Subject: [edk2-devel]

[edk2-devel] [Patch V2] BaseTools: Fix checking for Sources section in INF file

2019-08-01 Thread Christian Rodriguez
BZ: https://bugzilla.tianocore.org/show_bug.cgi?id=1804 The check to see if [Sources] section lists all the header type files of a module is missing the exclusion of source files that fall under the scope of Package includes. This change adds the exclusions. Signed-off-by: Christian Rodriguez