[scikit-learn] 2 million samples dataset caused python and OS crash

2021-01-06 Thread Liu James
Hi all, I'm using a medium dataset KDD99 IDS( https://www.ll.mit.edu/r-d/datasets/1999-darpa-intrusion-detection-evaluation-dataset) for model training, and the dataset has 2 million samples. When using fit_transform(), the OS crashed with log "Process 13851(python) of user xxx dumped core. Sta

Re: [scikit-learn] 2 million samples dataset caused python and OS crash

2021-01-07 Thread Liu James
gt;> Github Profile <http://github.com/ahowe42> >> Personal Website <http://www.andrewhowe.com> >> I live to learn, so I can learn to live. - me >> <~~~> >> >> >> On Wed, Jan 6, 2021 at 11:02 AM Liu James wrote: >> >>> Hi al