(The more I read about the "glitches" in the Obamacare website, the more it seems to me that the system was never tested. I assume that it will eventually be fixed but it is unheard of for a system to go into production with so many flaws. When we were implementing a client-server financial system at Columbia University, we spent 3 months stress testing it even after the users were satisfied that it satisfied their business functions. This meant having a dozen users banging away at it to make sure that a transaction could be logged in a reasonable amount of time. This system reminds me of how we used to joke about buggy systems as being "tested in production".)
NY Times October 20, 2013 Contractors See Weeks of Work on Health Site By SHARON LaFRANIERE, IAN AUSTEN and ROBERT PEAR Federal contractors have identified most of the main problems crippling President Obama’s online health insurance marketplace, but the administration has been slow to issue orders for fixing those flaws, and some contractors worry that the system may be weeks away from operating smoothly, people close to the project say. Administration officials approached the contractors last week to see if they could perform the necessary repairs and reboot the system by Nov. 1. However, that goal struck many contractors as unrealistic, at least for major components of the system. Some specialists working on the project said the online system required such extensive repairs that it might not operate smoothly until after the Dec. 15 deadline for people to sign up for coverage starting in January, although that view is not universally shared. In interviews, experts said the technological problems of the site went far beyond the roadblocks to creating accounts that continue to prevent legions of users from even registering. Indeed, several said, the login problems, though vexing to consumers, may be the easiest to solve. One specialist said that as many as five million lines of software code may need to be rewritten before the Web site runs properly. “The account creation and registration problems are masking the problems that will happen later,” said one person involved in the repair effort. The scrambling underscores the pressures on the administration to fix what is widely viewed as the president’s biggest domestic achievement. Millions of Americans have spent countless hours in frustration trying to use the federal Web site, healthcare.gov, and its extensive problems have become a political crisis for the administration, providing new opportunities for Republicans who want to roll back the health care law. Over the weekend, officials sought to counter pronouncements of failure by announcing that almost half a million people have submitted applications for health insurance through the federal and state marketplaces, about half of them through state exchanges. But officials declined to say how many have actually enrolled in insurance plans, and executives from insurance companies, which receive the enrollment files from the government, say their numbers have been low. The enrollment period ends March 31; those who go without coverage may be subject to fines. On Monday, Mr. Obama will host a Rose Garden event with people who have successfully enrolled in the health care exchanges. White House aides said he will acknowledge that the technical problems are “inexcusable,” but will note, as one adviser said, that the health care law is “more than a Web site.” “There’s great demand for the affordable health care coverage made available by the A.C.A.,” Jennifer Palmieri, the White House communications director, said Sunday, referring to the Affordable Care Act. “The challenge for all of us — the state and federal governments and contractors alike — is to make sure the American people can access it simply. We won’t rest until they can.” Senior officials took to the Sunday talk shows to defend the Affordable Care Act, and Republicans countered them. Senator Marco Rubio, Republican of Florida, said on “Fox News Sunday” that the early failures do not bode well for the rest of the health care law, adding: “In the 21st century, setting up a Web site where people can go on and buy something is not that complicated.” One major problem slowing repairs, people close to the program say, is that the Centers for Medicare and Medicaid Services, the federal agency in charge of the exchange, is responsible for making sure that the separately designed databases and pieces of software from 55 contractors work together. It is not common for a federal agency to assume that role, and numerous people involved in the project said the agency did not have the expertise to do the job and did not fully understand what it entailed. The people close to the project spoke on the condition of anonymity because they were not authorized to discuss the system’s problems. Administration officials have been debating whether to designate one or more companies as the quarterback for information technology work on the federal exchange, a complex project that has cost more than $400 million. Communications between the administration and contractors improved over the weekend as the Centers for Medicare and Medicaid Services began negotiating agreements with contractors on responsibility and deadlines for repairs, people involved in the project say. They hope to have a plan before a Congressional hearing set for Thursday. “The issue right now is between C.M.S. and the White House,” a specialist said Friday before communications improved. “Everybody sits and waits and the meter runs.” A part of the system, hidden from users, draws data from several federal and state databases to determine if consumers qualify for coverage and then calculates the subsidies for which they may be eligible. Another part of the system sends enrollment data to insurers. Several people involved in the project say that problems like those of the last three weeks are not uncommon when software from several companies is combined into a large, complex system. Insurance executives said in interviews that they were frustrated because they did not know the government’s plan or schedule for repairs. Insurers have found that the system provides them with incorrect information about some enrollees, repeatedly enrolls and cancels the enrollments of others, and simply loses the enrollments of still others. Correcting those errors, specialists said, could require extensive rewriting of software code. Insurers said it could be weeks before their data and the government’s could be reconciled. Accurate enrollment data is essential. Even if consumers bypass the federal Web site and go directly to insurance companies to sign up for coverage, the Treasury Department will still need enrollment data to pay tens of billions of dollars in subsidies promised to insurers. Confidential government documents show that some technical fixes have been made to the federal Web site, and specialists say the site is slowly improving. Nevertheless, disarray has distinguished the project. In the last 10 months alone, government documents show, officials modified hardware and software requirements for the exchange seven times. It went live on Oct. 1 before the government and contractors had fully tested the complete system. Delays by the government in issuing specifications for the system reduced the time available for testing. CGI Federal, a unit of the CGI Group, based in Montreal, has the biggest contract and is responsible for the architecture of major parts of the system, but not for its integration. Quality Software Services Inc., or Q.S.S.I., a unit of the UnitedHealth Group, developed the identity management system, another major component that allowed consumers to register and establish accounts. The identity management system from Q.S.S.I., which also taps into government databases to retrieve users’ personal information, was a particular source of trouble when the exchange opened. Change orders show that on Oct. 4 — after millions of people had been trapped in technological loops trying merely to log in — the government asked CGI to help it devise a new identity management system to replace the one provided by Q.S.S.I. But specialists said that approach was abandoned as too risky. Ultimately it was decided to fix the current identity system. According to one specialist, the Web site contains about 500 million lines of software code. By comparison, a large bank’s computer system is typically about one-fifth that size. Sharon LaFraniere reported from New York, Ian Austen from Ottawa, and Robert Pear from Washington. Michael D. Shear contributed reporting from Washington, and Reed Abelson from New York. _______________________________________________ pen-l mailing list [email protected] https://lists.csuchico.edu/mailman/listinfo/pen-l
