Mike,
I have upgraded to 1.1.11 (specifically) after posting and have still seen
the same error. I also used the event override you posted in issue #3994.
Since these experiments I have upgraded to 1.1.13 and the issues persist.
Unfortunately I can't give you permission to our database instance
(customer policies) but am able to cooperate as much as possible.
Like said in my post, I need to write multiple pandas dataframes with
millions of rows. Not looking really forward to doing this with my own
function. ;-)
Dirk Biesinger
*dirk.biesin...@gmail.com <dirk.biesin...@gmail.com> | **206.349.9769*
*"Simplicity is the Mastery of Complexity"*
On Mon, Sep 11, 2017 at 4:45 PM, Mike Bayer <mike...@zzzcomputing.com>
wrote:
> On Mon, Sep 11, 2017 at 6:34 PM, dirk.biesinger
> <dirk.biesin...@gmail.com> wrote:
> > I am encountering errors when trying to use the pd.to_sql function to
> write
> > a dataframe to MS SQL Data Warehouse.
> > The connection works when NOT using sqlalchemy engines.
> > I can read dataframes as well as row-by-row via select statements when I
> use
> > pyodbc connections
> > I can write data via insert statements (as well as delete data) when
> using
> > pyodbc.
> > However, when I try to connect using a sqlalchemy engine I run into a
> string
> > of error messages starting with:
> >
> > ProgrammingError: (pyodbc.ProgrammingError) ('42000', "[42000]
> > [Microsoft][ODBC Driver 13 for SQL Server][SQL Server]Catalog view
> > 'dm_exec_sessions' is not supported in this version. (104385)
> > (SQLExecDirectW)")
> >
> >
> > I have searched online, and this exact error seems to have been reported
> /
> > evaluated in May of this year as issue #3994:
> >
> >
> > https://bitbucket.org/zzzeek/sqlalchemy/issues/3994/azure-
> sql-datawarehouse-basic
>
> the issue originally reported there is the one you are having, it was
> resolved as of 1.1.11. I have closed the issue as I would need new
> issues opened to deal with the subsequent issues that user was having.
> If you upgrade to 1.1.11, you should no longer receive an error
> about dm_exec_sessions because this error is caught and the next view,
> sys.dm_pdw_nodes_exec_sessions, is used. There are likely problems
> beyond that error message but they should not be that message.
> please open new issues to describe these error messages and keep in
> mind it is unlikely I can fix them unless someone gives me access to
> this database.
>
>
> >
> >
> > I could not find a solution to this, and I'd really dislike to do a
> > line-wise or blob insert statement (I'm working with multiple datasets
> that
> > each has a few million rows, so execution time is a consideration,
> although
> > the result sets I'm getting are more like in the 100k lines area each.)
> >
> >
> > I get the same error messages even when I replace the pd.to_sql command
> with
> > a simple engine.connect()
> >
> >
> > Enclosed my installed packages (packages.list)
> >
> > Enclosed the full traceback (traceback.txt)
> >
> >
> > This is the code I'm using:
> >
> > connection_string =
> > "mssql+pyodbc://<username>:<password>@<sqlhost>.database.windows.net
> :<port>/<database>?driver=ODBC+Driver+13+for+SQL+Server"
> > engn = sqlalchemy.engine.create_engine(connection_string, echo=True)
> > engn.connect()
> >
> >
> > I'm very well aware that MS SQL DataWarehouse behaves a bit different, so
> > I'm open for some experimenting to get this issue narrowed down.
> >
> > In case it matters: I'm running an ubuntu 16.04 VM on azure with jupyter
> > notebook server and python 3.6.1.
> >
> > Best,
> >
> > DB
> >
> > --
> > SQLAlchemy -
> > The Python SQL Toolkit and Object Relational Mapper
> >
> > http://www.sqlalchemy.org/
> >
> > To post example code, please provide an MCVE: Minimal, Complete, and
> > Verifiable Example. See http://stackoverflow.com/help/mcve for a full
> > description.
> > ---
> > You received this message because you are subscribed to the Google Groups
> > "sqlalchemy" group.
> > To unsubscribe from this group and stop receiving emails from it, send an
> > email to sqlalchemy+unsubscr...@googlegroups.com.
> > To post to this group, send email to sqlalchemy@googlegroups.com.
> > Visit this group at https://groups.google.com/group/sqlalchemy.
> > For more options, visit https://groups.google.com/d/optout.
>
> --
> SQLAlchemy -
> The Python SQL Toolkit and Object Relational Mapper
>
> http://www.sqlalchemy.org/
>
> To post example code, please provide an MCVE: Minimal, Complete, and
> Verifiable Example. See http://stackoverflow.com/help/mcve for a full
> description.
> ---
> You received this message because you are subscribed to the Google Groups
> "sqlalchemy" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to sqlalchemy+unsubscr...@googlegroups.com.
> To post to this group, send email to sqlalchemy@googlegroups.com.
> Visit this group at https://groups.google.com/group/sqlalchemy.
> For more options, visit https://groups.google.com/d/optout.
>
--
SQLAlchemy -
The Python SQL Toolkit and Object Relational Mapper
http://www.sqlalchemy.org/
To post example code, please provide an MCVE: Minimal, Complete, and Verifiable
Example. See http://stackoverflow.com/help/mcve for a full description.
---
You received this message because you are subscribed to the Google Groups
"sqlalchemy" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to sqlalchemy+unsubscr...@googlegroups.com.
To post to this group, send email to sqlalchemy@googlegroups.com.
Visit this group at https://groups.google.com/group/sqlalchemy.
For more options, visit https://groups.google.com/d/optout.
