On Wed, 28 Jul 2010, Bram Moolenaar wrote: > > So far we have been testing by hoping for people to install Vim and > use it. This does find problems related to daily use, but I suspect > quite a few things are not yet used and bugs go unnoticed. Then when > Vim 7.3 is released new features get used and bugs are uncovered. Too > late! > > It would be good if we have someone systematically going through new > features and recent changes, making a list of use cases that need to > be tested. Possibly using the help as a guideline and brainstorming > of situations and border cases that might have problems. > > Then we need to have people who take one of the uses cases and run > through them. Verify that it works as expected. Try a few variants > while doing that. This should not take much time. > > I have started a shared document for this. it's very rudimentary: > https://docs.google.com/document/edit?id=1CyOvJqKYoTmL4D50w2htYMG7xt5SADcIX6r7zZ978HQ&hl=en&authkey=COfQ_6oD > > I need to spend my time on fixing bugs, it would be great if someone > can step forward to coordinate this testing. This includes making the > layout of the document better and keeping an eye on the progress. > > I also wonder if a shared document is the best way to do these things. > At least this allows multiple people at the same time making changes. > Most wiki's are not good at that. > > Comments?
Is anyone aware of anything like a terminal-emulator version of Selenium? I've thought for several things like this that that would be incredibly useful. Brief summary of Selenium is that it's an automated web application testing toolkit. It consists of a scripting language with capabilities like (pseudocode): open(URL) type 'bhaskell' in the 'username' field click the button with name 'login' and corresponding tests, like: verify that the text 'logged in' appears in the current page ensure that there's a 'div' with id attribute 'maincontent' It has support for a wide range of browsers (ie/moz/chromium/opera). And it supports creating template profiles (so, starting Firefox with GreaseMonkey already installed). I've used it at my current job to test things via a headless X server (Xvfb). For Vim's purposes, a similar framework with support for a wide range of terminal emulators (for non-gvim) and the major GUI frameworks (Vim supports GTK and ...?) would be very handy. Scripts like: execute(vim -U NONE -u NONE -N) " start vim type ':e testfile' " edit a new file type 'isometext<esc>' " insert 'sometext' click and drag from column 3-6 " highlight the 'mete' portion type 'o' " open new line middle-click on terminal " terminal-paste the 'mete' Tests like: ensure that the buffer displays "sometext\nmete" -- Best, Ben -- You received this message from the "vim_dev" maillist. Do not top-post! Type your reply below the text you are replying to. For more information, visit http://www.vim.org/maillist.php
