On Tue, Dec 1, 2020, at 3:16 PM, Bill Finn wrote: > On Tue, Dec 1, 2020 at 7:42 PM Mike Bayer <mike...@zzzcomputing.com> wrote: >>>> do your "tests" each run in separate processes? >>> >>> Heh, is "tests" surrounding in quotes because we're constructing our entire >>> data model for each test? FWIW, we call them integration tests, and we >>> aren't under the illusion that they are unit tests. To answer your >>> question, when we run the entire test suite, we parallelize ≈13k tests >>> across tens of processes, and it takes 10-25 minutes. >> right I asked earlier if that's what you were doing. this is not unlike >> starting and stopping the database for each test, which would also make >> tests take many seconds each so it's better to create the datamodel just >> once per process and have it used among many tests (unless a single test is >> just one process?) > > Yes, this makes sense. When we run the entire test suite, we create the data > model just once (per parallelized process), and this part is clear to me. > Thank you. > >>>> or is the use case when you are working on something and just want to run >>>> one test? >>> >>> Yes, this is the use case I'm trying to optimize for. >> for now you'd have to try to limit the import scope or otherwise perhaps >> identify if some element of the model is taking a particularly long time to >> initialize in which case we can take a look. > > Makes sense, thanks. FWIW, I'll link this older issue where you helped our > slow test performance problems by updating SQLAlchemy's accessing of an > enum's `__members__`: > > https://github.com/sqlalchemy/sqlalchemy/issues/4758
oh that was a goofy one too, yeah. that one was major. could be another one lurking! > > Obviously, that problem has been addressed, but I wanted to say thank you! > > Bill > >> >> >>> >>> Bill >>> >>> -- >>> SQLAlchemy - >>> The Python SQL Toolkit and Object Relational Mapper >>> >>> http://www.sqlalchemy.org/ >>> >>> To post example code, please provide an MCVE: Minimal, Complete, and >>> Verifiable Example. See http://stackoverflow.com/help/mcve for a full >>> description. >>> --- >>> You received this message because you are subscribed to the Google Groups >>> "sqlalchemy" group. >>> To unsubscribe from this group and stop receiving emails from it, send an >>> email to sqlalchemy+unsubscr...@googlegroups.com. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/sqlalchemy/CANTn%2BY2pA_6%3Df4mQU21j7oTehHTnCvGe2aYa8%2BynmkPggXKomQ%40mail.gmail.com >>> >>> <https://groups.google.com/d/msgid/sqlalchemy/CANTn%2BY2pA_6%3Df4mQU21j7oTehHTnCvGe2aYa8%2BynmkPggXKomQ%40mail.gmail.com?utm_medium=email&utm_source=footer>. >> >> >> -- >> SQLAlchemy - >> The Python SQL Toolkit and Object Relational Mapper >> >> http://www.sqlalchemy.org/ >> >> To post example code, please provide an MCVE: Minimal, Complete, and >> Verifiable Example. See http://stackoverflow.com/help/mcve for a full >> description. >> --- >> You received this message because you are subscribed to the Google Groups >> "sqlalchemy" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to sqlalchemy+unsubscr...@googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/sqlalchemy/cb910e44-2c47-4d58-ae08-eb95152ba8a2%40www.fastmail.com >> >> <https://groups.google.com/d/msgid/sqlalchemy/cb910e44-2c47-4d58-ae08-eb95152ba8a2%40www.fastmail.com?utm_medium=email&utm_source=footer>. > > -- > SQLAlchemy - > The Python SQL Toolkit and Object Relational Mapper > > http://www.sqlalchemy.org/ > > To post example code, please provide an MCVE: Minimal, Complete, and > Verifiable Example. See http://stackoverflow.com/help/mcve for a full > description. > --- > You received this message because you are subscribed to the Google Groups > "sqlalchemy" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to sqlalchemy+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/sqlalchemy/CANTn%2BY3LByMbJxiohHUXkwSL%3DpAH_hKePZ_7GvkRUew08LF_cQ%40mail.gmail.com > > <https://groups.google.com/d/msgid/sqlalchemy/CANTn%2BY3LByMbJxiohHUXkwSL%3DpAH_hKePZ_7GvkRUew08LF_cQ%40mail.gmail.com?utm_medium=email&utm_source=footer>. -- SQLAlchemy - The Python SQL Toolkit and Object Relational Mapper http://www.sqlalchemy.org/ To post example code, please provide an MCVE: Minimal, Complete, and Verifiable Example. See http://stackoverflow.com/help/mcve for a full description. --- You received this message because you are subscribed to the Google Groups "sqlalchemy" group. To unsubscribe from this group and stop receiving emails from it, send an email to sqlalchemy+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/sqlalchemy/4e22c30d-eb96-44ba-9aef-01b9f0a75410%40www.fastmail.com.
