Btw, the latest version does not require 2) any more, meaning the lookup table could consist of more than one files. However, it still must be small enough to stay in memory.
On Tue, Mar 3, 2015 at 10:36 PM, hongbin ma <[email protected]> wrote: > On Tue, Mar 3, 2015 at 6:26 PM, Luke Han <[email protected]> wrote: > > > CreateDictionaryJob > > > > hi, for lookup tables, we assume 1. they're small in size(compared to > fact table) 2. consist of only one file in hive > > please stick to the assumption. > > thanks > hongbin >
