Hi, I’m trying to make some assertions over my application log messages. That’s how I found it out. So, yes, the pipeline is intentionally failing.
Curiously, I didn’t have this issue on previous crunch versions (0.11.0-cdh5.4.2). I just think that the final error message may be a little bit misleading to someone that does not know Crunch and the application. Last but not least, as someone has explicitly said that dotfile is built even if its generation is disabled, I would like to understand why. Thank you! (I not so available right now, but I may report/fix it as soon as I have some free time). Giovanni GATTI PINHEIRO Ingénieur Développement Volt Europe pour Médiamétrie www.mediametrie.fr<https://mediametrie.letsignit.com/r/0/ffc18e5a-c11d-417d-86a9-e5f34b1d8e41/undefined> De : Gabriel Reid [mailto:[email protected]] Envoyé : mercredi 21 juin 2017 15:05 À : [email protected] Objet : Re: Dotfile default generation Hi Giovanni, I believe that the building of the general job dotfile was added to Crunch before the default disabling of the other dotfiles was added, and so it is always created to maintain backwards compatibility. Please feel free to log a ticket (or even better, provide a patch) to have have this changed at https://issues.apache.org/jira/browse/CRUNCH. By the way, if exceptions like the one you mentioned ("Problem creating debug dotfile: Input source Avro(…) does not exist!”) are being logged, doesn't this mean that your pipeline execution is also failing? - Gabriel 2017-06-21 14:41 GMT+02:00 Giovanni GATTI PINHEIRO <[email protected]<mailto:[email protected]>>: Hello, I would like to understand the reason why DotfileUtil.buildPlanDotfile builds the dotfile despite of dotfile-debug mode is enabled or not. This may generate weird log messages such as “Problem creating debug dotfile: Input source Avro(…) does not exist!” if input file is missing. Thank you in advance. Giovanni GATTI PINHEIRO Ingénieur Développement Volt Europe pour Médiamétrie Email : [email protected]<mailto:[email protected]> Buropolis Les Bouillides - 1240, Route des Dolines 06560 Valbonne Sophia-Antipolis - France www.mediametrie.fr<https://mediametrie.letsignit.com/r/0/3434a4c2-64a7-41d5-ac27-119b0107dac8/94b7aced-c2e8-40bd-a973-df07a77e3bbf> [cid:[email protected]]<https://mediametrie.letsignit.com/r/5/c2b7ffb6-8501-42ca-9278-776bb854246b/ed470b86-9a08-46a8-b51f-5e98f4a9daf7> Nous vous rappelons que les résultats de Médiamétrie sont et demeurent sa propriété : ils sont protégés au double titre du droit d'auteur et de la protection des bases de données. Ce message est confidentiel et établi à l'intention de ses destinataires. Tout message électronique étant susceptible d'altération, la société Médiamétrie décline toute responsabilité s'il a été altéré, déformé ou falsifié. We remind you that the results produced by Médiamétrie are and remain its sole property covered by both copyright and databases protection. This message is confidential and intended solely for the adressees. E-mails are susceptible to alteration. Neither Médiamétrie company shall be liable for the message if altered, changed or falsified.
