I'm a little confused. So the idea is to build source code from HDP using Bigtop? If that is true, then as Masatake mentioned removing a patch is not enough. You may need to change do-component-build, install_<component>, and even those svc and configuration files, to make it work with existing HDP components.
Masatake Iwasaki <[email protected]> 于2021年6月3日周四 下午2:36写道： > > I want to build an old version of HDP. > > I think you need some considerations. > > * Products of HDP x.y.z is expected to be built against products of HDP > x.y.z. > The versions of products of HDP and Bigtop do not match. > You will need to fix scripts of Bigtop for resolving mismatch. > (do-component-build and install_*.sh tend to be relevant.) > > * Even if you succeeded to build Bigtop package from HDP source code, > the contents should be quite different from HDP one. > (You should just use .srpm of HDP for building .rpm of HDP if > available.) > > * Artifacts of HDP usually depend on HDP specific artifacts > published in Hortonworks Maven repositories. > (This could be resolved by just tweaking ~/.m2/settings.xml or pom.xml > of products.) > > > > Practical example: *In master:* I want to build spark 2.3.0. If I use > > bigtop.bom or git to build both fail when they try to apply > > patch2-snappy-java-1.1.8.diff. > > The master branch of Bigtop is expected to build Spark 3 against Hadoop 3. > > https://github.com/apache/bigtop/commit/f47d4bcb16e67f50b2403f4fc5071b60ec88c081 > > Just removing patches should not be enough. > > > On 2021/06/03 10:26, Jun HE wrote: > > Hi Matt, > > > > Are you just trying to disable a certain patch temporarily? If yes, my > > understanding is that just delete that patch > > in bigtop-packages/src/common/<component>/ would work. Pls have a try. > > > > Regards, > > > > Jun > > > > Matt Andruff <[email protected]> 于2021年6月3日周四 上午4:16写道： > > > >> Good Day Team, > >> > >> I want to build an old version of HDP. Theoretically I should be able > to > >> do that with BigTop, but I'm having issues because patches are running > and > >> not finding what they're looking for and failing my build. > >> > >> How do I turn off a patch intended for a different version (say spark > >> 2.3.0)? > >> > >> Practical example: *In master:* I want to build spark 2.3.0. If I use > >> bigtop.bom or git to build both fail when they try to apply > >> patch2-snappy-java-1.1.8.diff. > >> Which is totally needed for a fix in some later version of spark, but > not > >> the version I'm using. As far as I can tell, there isn't a way to turn > >> on/off specific version patches, or perhaps this patch isn't following > the > >> paradigm. > >> > >> Should I open a ticket to create a new functionality that only applies > >> patches to specific versions? Or is this already baked in and I have > hit a > >> subtle bug? > >> Thoughts? > >> > > >
