JeremyYao commented on issue #1290:
URL:
https://github.com/apache/daffodil-vscode/issues/1290#issuecomment-3113638359
#### Separate `extest` calls
When I change the extension script to `"test:ui": "extest get-vscode &&
extest get-chromedriver && extest install-vsix --vsix_file
apache-daffodil-vscode-1.4.2-SNAPSHOT.vsix && extest run-tests
./out/tests/suite/ui-test/*.js"`
The UI tests runs but the test is performed in the developer's instance of
VSCode. Additionally, it relies on us calling `yarn package` to get the .vsix
file.
The behavior of the tests is inconsistent at times too. It may fail or pass.
Some example console outputs are below
```Powershell
PS C:\Users\USERNAME\repos\daffodil-vscode> yarn test:ui
yarn run v1.22.22
warning apache-daffodil-vscode@1.4.2-SNAPSHOT: The engine "vscode" appears
to be invalid.
$ extest get-vscode && extest get-chromedriver && extest install-vsix
--vsix_file apache-daffodil-vscode-1.4.2-SNAPSHOT.vsix && extest run-tests
./out/tests/suite/ui-test/*.js
Warning: You are using the untested NodeJS version '22.14.0'. The latest
supported version is '20.x.x'.
We recommend to use tested version to have ExTester working
properly.
Downloading VS Code: 1.102.2 / stable
VS Code exists in local cache, skipping download
Warning: You are using the untested NodeJS version '22.14.0'. The latest
supported version is '20.x.x'.
We recommend to use tested version to have ExTester working
properly.
ChromeDriver 134.0.6998.165 exists in local cache, skipping download
Warning: You are using the untested NodeJS version '22.14.0'. The latest
supported version is '20.x.x'.
We recommend to use tested version to have ExTester working
properly.
Processing VSIX file: apache-daffodil-vscode-1.4.2-SNAPSHOT.vsix
File is not a valid URL. Checking existence:
apache-daffodil-vscode-1.4.2-SNAPSHOT.vsix
Installing extensions...
Extension 'apache-daffodil-vscode-1.4.2-SNAPSHOT.vsix' was successfully
installed.
Warning: You are using the untested NodeJS version '22.14.0'. The latest
supported version is '20.x.x'.
We recommend to use tested version to have ExTester working
properly.
Writing code settings to
C:\Users\USERNAME\AppData\Local\Temp\test-resources\settings\User\settings.json
Launching browser...
DevTools listening on
ws://127.0.0.1:63782/devtools/browser/7fe072ea-6bae-4c2b-b1ea-7af1a613872f
Warning: 'allow-pre-commit-input' is not in the list of known options, but
still passed to Electron/Chromium.
Warning: 'disable-background-networking' is not in the list of known
options, but still passed to Electron/Chromium.
Warning: 'disable-backgrounding-occluded-windows' is not in the list of
known options, but still passed to Electron/Chromium.
Warning: 'disable-client-side-phishing-detection' is not in the list of
known options, but still passed to Electron/Chromium.
Warning: 'disable-default-apps' is not in the list of known options, but
still passed to Electron/Chromium.
Warning: 'disable-hang-monitor' is not in the list of known options, but
still passed to Electron/Chromium.
Warning: 'disable-popup-blocking' is not in the list of known options, but
still passed to Electron/Chromium.
Warning: 'disable-prompt-on-repost' is not in the list of known options, but
still passed to Electron/Chromium.
Warning: 'disable-sync' is not in the list of known options, but still
passed to Electron/Chromium.
Warning: 'enable-automation' is not in the list of known options, but still
passed to Electron/Chromium.
Warning: 'enable-logging' is not in the list of known options, but still
passed to Electron/Chromium.
Warning: 'log-level' is not in the list of known options, but still passed
to Electron/Chromium.
Warning: 'first-run' is not in the list of known options, but still passed
to Electron/Chromium.
Warning: 'service-autorun' is not in the list of known options, but still
passed to Electron/Chromium.
Warning: 'remote-debugging-port' is not in the list of known options, but
still passed to Electron/Chromium.
Warning: 'test-type' is not in the list of known options, but still passed
to Electron/Chromium.
Warning: 'use-mock-keychain' is not in the list of known options, but still
passed to Electron/Chromium.
[main 2025-07-24T14:11:47.170Z] update#setState idle
[main 2025-07-24T14:11:47.286Z] Error: Error mutex already exists
at Ru.S
(file:///C:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/main.js:125:18488)
[456:0724/101147.509:ERROR:direct_composition_support.cc(1122)]
QueryInterface to IDCompositionDevice4 failed: No such interface supported
(0x80004002)
[15092:0724/101149.202:INFO:CONSOLE(35)] "%c WARN color: #993 Via
'product.json#extensionEnabledApiProposals' extension
'ms-vsliveshare.vsliveshare' wants API proposal 'notebookCellExecutionState'
but that proposal DOES NOT EXIST. Likely, the proposal has been finalized
(check 'vscode.d.ts') or was abandoned.", source:
vscode-file://vscode-app/c:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/vs/workbench/workbench.desktop.main.js
(35)
[15092:0724/101149.203:INFO:CONSOLE(35)] "%c WARN color: #993 Via
'product.json#extensionEnabledApiProposals' extension 'ms-python.gather' wants
API proposal 'notebookCellExecutionState' but that proposal DOES NOT EXIST.
Likely, the proposal has been finalized (check 'vscode.d.ts') or was
abandoned.", source:
vscode-file://vscode-app/c:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/vs/workbench/workbench.desktop.main.js
(35)
[15092:0724/101149.203:INFO:CONSOLE(35)] "%c WARN color: #993 Via
'product.json#extensionEnabledApiProposals' extension
'ms-python.vscode-pylance' wants API proposal 'mcpConfigurationProvider' but
that proposal DOES NOT EXIST. Likely, the proposal has been finalized (check
'vscode.d.ts') or was abandoned.", source:
vscode-file://vscode-app/c:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/vs/workbench/workbench.desktop.main.js
(35)
Browser ready in 3918 ms
Launching tests...
Example extension view tests
[15092:0724/101149.690:INFO:CONSOLE(35)] "%c INFO color: #33f Started local
extension host with pid 16200.", source:
vscode-file://vscode-app/c:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/vs/workbench/workbench.desktop.main.js
(35)
[15092:0724/101150.080:INFO:CONSOLE(35)] "%c INFO color: #33f
ChatSessionStore: Migrating 0 chat sessions from storage service to file
system", source:
vscode-file://vscode-app/c:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/vs/workbench/workbench.desktop.main.js
(35)
[15092:0724/101150.521:INFO:CONSOLE(35)] "%c ERR color: #f33 Extension
'ms-python.vscode-pylance' wants API proposal 'mcpConfigurationProvider' but
that proposal DOES NOT EXIST. Likely, the proposal has been finalized (check
'vscode.d.ts') or was abandoned.", source:
vscode-file://vscode-app/c:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/vs/workbench/workbench.desktop.main.js
(35)
[15092:0724/101152.069:INFO:CONSOLE(35)] "%c INFO color: #33f Settings Sync:
Account status changed from uninitialized to unavailable", source:
vscode-file://vscode-app/c:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/vs/workbench/workbench.desktop.main.js
(35)
[15092:0724/101153.753:INFO:CONSOLE(35)] "%c INFO color: #33f [perf] Render
performance baseline is 31ms", source:
vscode-file://vscode-app/c:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/vs/workbench/workbench.desktop.main.js
(35)
1) "before all" hook for "Check the extension info"
Shutting down the browser
[15092:0724/101154.358:INFO:CONSOLE(35)] "%c ERR color: #f33 Canceled:
Canceled", source:
vscode-file://vscode-app/c:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/vs/workbench/workbench.desktop.main.js
(35)
[15092:0724/101154.359:INFO:CONSOLE(35)] "%c ERR color: #f33 Canceled:
Canceled", source:
vscode-file://vscode-app/c:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/vs/workbench/workbench.desktop.main.js
(35)
[main 2025-07-24T14:11:54.447Z] Extension host with pid 16200 exited with
code: 0, signal: unknown.
0 passing (9s)
1) Example extension view tests
"before all" hook for "Check the extension info":
StaleElementReferenceError: stale element reference: stale element not
found in the current frame
(Session info: chrome=134.0.6998.205)
at Object.throwDecodedError
(node_modules\selenium-webdriver\lib\error.js:523:15)
at parseHttpResponse
(node_modules\selenium-webdriver\lib\http.js:524:13)
at Executor.execute
(node_modules\selenium-webdriver\lib\http.js:456:28)
at process.processTicksAndRejections
(node:internal/process/task_queues:105:5)
at async Driver.execute
(node_modules\selenium-webdriver\lib\webdriver.js:745:17)
at async DefaultTreeSection.findElements
(node_modules\selenium-webdriver\lib\webdriver.js:2675:20)
at async Object.default
(node_modules\@redhat-developer\page-objects\out\locators\locators.js:53:17)
at async ViewContent.createSection
(node_modules\@redhat-developer\page-objects\out\components\sidebar\ViewContent.js:79:13)
at async ViewContent.getSections
(node_modules\@redhat-developer\page-objects\out\components\sidebar\ViewContent.js:68:27)
at async ViewContent.getSection
(node_modules\@redhat-developer\page-objects\out\components\sidebar\ViewContent.js:43:26)
at async ExtensionsViewSection.findItem
(node_modules\@redhat-developer\page-objects\out\components\sidebar\extensions\ExtensionsViewSection.js:71:26)
INFO: Screenshots of failures can be found in:
C:\Users\USERNAME\AppData\Local\Temp\test-resources\screenshots\20250724T101145
error Command failed with exit code 1.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this
command.
PS C:\Users\USERNAME\repos\daffodil-vscode> yarn test:ui
yarn run v1.22.22
warning apache-daffodil-vscode@1.4.2-SNAPSHOT: The engine "vscode" appears
to be invalid.
$ extest get-vscode && extest get-chromedriver && extest install-vsix
--vsix_file apache-daffodil-vscode-1.4.2-SNAPSHOT.vsix && extest run-tests
./out/tests/suite/ui-test/*.js
Warning: You are using the untested NodeJS version '22.14.0'. The latest
supported version is '20.x.x'.
We recommend to use tested version to have ExTester working
properly.
Downloading VS Code: 1.102.2 / stable
VS Code exists in local cache, skipping download
Warning: You are using the untested NodeJS version '22.14.0'. The latest
supported version is '20.x.x'.
We recommend to use tested version to have ExTester working
properly.
ChromeDriver 134.0.6998.165 exists in local cache, skipping download
Warning: You are using the untested NodeJS version '22.14.0'. The latest
supported version is '20.x.x'.
We recommend to use tested version to have ExTester working
properly.
Processing VSIX file: apache-daffodil-vscode-1.4.2-SNAPSHOT.vsix
File is not a valid URL. Checking existence:
apache-daffodil-vscode-1.4.2-SNAPSHOT.vsix
Installing extensions...
Extension 'apache-daffodil-vscode-1.4.2-SNAPSHOT.vsix' was successfully
installed.
Warning: You are using the untested NodeJS version '22.14.0'. The latest
supported version is '20.x.x'.
We recommend to use tested version to have ExTester working
properly.
Writing code settings to
C:\Users\USERNAME\AppData\Local\Temp\test-resources\settings\User\settings.json
Launching browser...
DevTools listening on
ws://127.0.0.1:63838/devtools/browser/43754f86-5d9d-4c5e-9d03-d89d82d44882
Warning: 'allow-pre-commit-input' is not in the list of known options, but
still passed to Electron/Chromium.
Warning: 'disable-background-networking' is not in the list of known
options, but still passed to Electron/Chromium.
Warning: 'disable-backgrounding-occluded-windows' is not in the list of
known options, but still passed to Electron/Chromium.
Warning: 'disable-client-side-phishing-detection' is not in the list of
known options, but still passed to Electron/Chromium.
Warning: 'disable-default-apps' is not in the list of known options, but
still passed to Electron/Chromium.
Warning: 'disable-hang-monitor' is not in the list of known options, but
still passed to Electron/Chromium.
Warning: 'disable-popup-blocking' is not in the list of known options, but
still passed to Electron/Chromium.
Warning: 'disable-prompt-on-repost' is not in the list of known options, but
still passed to Electron/Chromium.
Warning: 'disable-sync' is not in the list of known options, but still
passed to Electron/Chromium.
Warning: 'enable-automation' is not in the list of known options, but still
passed to Electron/Chromium.
Warning: 'enable-logging' is not in the list of known options, but still
passed to Electron/Chromium.
Warning: 'log-level' is not in the list of known options, but still passed
to Electron/Chromium.
Warning: 'first-run' is not in the list of known options, but still passed
to Electron/Chromium.
Warning: 'service-autorun' is not in the list of known options, but still
passed to Electron/Chromium.
Warning: 'remote-debugging-port' is not in the list of known options, but
still passed to Electron/Chromium.
Warning: 'test-type' is not in the list of known options, but still passed
to Electron/Chromium.
Warning: 'use-mock-keychain' is not in the list of known options, but still
passed to Electron/Chromium.
[4104:0724/101215.840:ERROR:direct_composition_support.cc(1122)]
QueryInterface to IDCompositionDevice4 failed: No such interface supported
(0x80004002)
[main 2025-07-24T14:12:15.999Z] update#setState idle
[main 2025-07-24T14:12:16.040Z] Error: Error mutex already exists
at Ru.S
(file:///C:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/main.js:125:18488)
[25156:0724/101217.342:INFO:CONSOLE(35)] "%c WARN color: #993 Via
'product.json#extensionEnabledApiProposals' extension
'ms-vsliveshare.vsliveshare' wants API proposal 'notebookCellExecutionState'
but that proposal DOES NOT EXIST. Likely, the proposal has been finalized
(check 'vscode.d.ts') or was abandoned.", source:
vscode-file://vscode-app/c:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/vs/workbench/workbench.desktop.main.js
(35)
[25156:0724/101217.343:INFO:CONSOLE(35)] "%c WARN color: #993 Via
'product.json#extensionEnabledApiProposals' extension 'ms-python.gather' wants
API proposal 'notebookCellExecutionState' but that proposal DOES NOT EXIST.
Likely, the proposal has been finalized (check 'vscode.d.ts') or was
abandoned.", source:
vscode-file://vscode-app/c:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/vs/workbench/workbench.desktop.main.js
(35)
[25156:0724/101217.344:INFO:CONSOLE(35)] "%c WARN color: #993 Via
'product.json#extensionEnabledApiProposals' extension
'ms-python.vscode-pylance' wants API proposal 'mcpConfigurationProvider' but
that proposal DOES NOT EXIST. Likely, the proposal has been finalized (check
'vscode.d.ts') or was abandoned.", source:
vscode-file://vscode-app/c:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/vs/workbench/workbench.desktop.main.js
(35)
[25156:0724/101217.656:INFO:CONSOLE(35)] "%c INFO color: #33f
ChatSessionStore: Migrating 0 chat sessions from storage service to file
system", source:
vscode-file://vscode-app/c:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/vs/workbench/workbench.desktop.main.js
(35)
Browser ready in 2608 ms
Launching tests...
Example extension view tests
[25156:0724/101217.871:INFO:CONSOLE(35)] "%c INFO color: #33f Started local
extension host with pid 3420.", source:
vscode-file://vscode-app/c:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/vs/workbench/workbench.desktop.main.js
(35)
[25156:0724/101218.326:INFO:CONSOLE(35)] "%c ERR color: #f33 Extension
'ms-python.vscode-pylance' wants API proposal 'mcpConfigurationProvider' but
that proposal DOES NOT EXIST. Likely, the proposal has been finalized (check
'vscode.d.ts') or was abandoned.", source:
vscode-file://vscode-app/c:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/vs/workbench/workbench.desktop.main.js
(35)
[25156:0724/101219.799:INFO:CONSOLE(35)] "%c INFO color: #33f Settings Sync:
Account status changed from uninitialized to unavailable", source:
vscode-file://vscode-app/c:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/vs/workbench/workbench.desktop.main.js
(35)
[25156:0724/101220.450:INFO:CONSOLE(35)] "%c ERR color: #f33 [Extension
Host] (node:3420) ExperimentalWarning: SQLite is an experimental feature and
might change at any time
(Use `Code --trace-warnings ...` to show where the warning was created)",
source:
vscode-file://vscode-app/c:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/vs/workbench/workbench.desktop.main.js
(35)
[25156:0724/101220.451:INFO:CONSOLE(518)] "%c[Extension Host] %c(node:3420)
ExperimentalWarning: SQLite is an experimental feature and might change at any
time
(Use `Code --trace-warnings ...` to show where the warning was created)
color: blue color: ", source:
vscode-file://vscode-app/c:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/vs/workbench/workbench.desktop.main.js
(518)
[25156:0724/101221.229:INFO:CONSOLE(35)] "%c INFO color: #33f [perf] Render
performance baseline is 33ms", source:
vscode-file://vscode-app/c:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/vs/workbench/workbench.desktop.main.js
(35)
1) Check the extension info
Shutting down the browser
[25156:0724/101223.641:INFO:CONSOLE(35)] "%c ERR color: #f33 Canceled:
Canceled", source:
vscode-file://vscode-app/c:/Users/USERNAME/AppData/Local/Temp/test-resources/VSCode-win32-x64-archive/resources/app/out/vs/workbench/workbench.desktop.main.js
(35)
[main 2025-07-24T14:12:25.194Z] Extension host with pid 3420 exited with
code: 0, signal: unknown.
0 passing (10s)
1 failing
1) Example extension view tests
Check the extension info:
AssertionError: expected 'Apache Software Foundation' to equal 'asf'
+ expected - actual
-Apache Software Foundation
+asf
at
C:\Users\USERNAME\repos\daffodil-vscode\out\tests\suite\ui-test\simple.test.js:74:36
at Generator.next (<anonymous>)
at fulfilled (out\tests\suite\ui-test\simple.test.js:21:58)
at process.processTicksAndRejections
(node:internal/process/task_queues:105:5)
INFO: Screenshots of failures can be found in:
C:\Users\USERNAME\AppData\Local\Temp\test-resources\screenshots\20250724T101215
error Command failed with exit code 1.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this
command.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@daffodil.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
