Testing is the single largest unpriced transfer
C3 · 12 of 13 assessable
In 12 of the 13 contracts we could assess on this point, no implementer testing hours and no testing fee appear anywhere in the document.
Assessable 13 of 16: fired 12, does not fire 1. Not assessable 3 — San Rafael and Sutter Creek (both Tyler Technologies) and Citizens Property Insurance (Applications Software Technology). By paper type: vendor-direct 7 of 7 assessable; integrator-led 5 of 6 assessable.
- C3
PowerSchool Group LLC, Utah State Board of Education: “Customer, or its designee, is responsible for managing Customer resources, organizational change management, data conversions and interfaces from legacy systems, and user acceptance testing.”
- C3
Workday, Inc., City of Orlando FL: “Customer will lead testing”
.
- C3
IBM Global Business Services, NuVasive, Inc. (SAP R/3): “IBM will provide templates and tools for validation and lead a team of NuVasive resources through the process. The actual execution of the validation is NuVasive’s responsibility”
.
- C3
Infor (US), LLC, City of Portland BES — our record of the clause: SIT and UAT scoped at ‘1 test iteration’ each; Customer develops the SIT and UAT scripts; no test hours stated. Infor creates only the unit and system test scripts, so this fires MEDIUM, not HIGH.
- C3
SAP America, Inc., Warnaco Inc. — our record of the clause: “business users and subject matter experts will perform user acceptance testing, supported by SAP Consultants”, a support and guidance role rather than silence, but no SAP test hours are stated anywhere in the readable text.
- C3
Ciber Global, LLC, Wright County MN (Oracle Fusion Cloud) — our record of the clause: Ciber leads creation of the test plan and initial scripts, but execution is joint, with no Ciber-specific hours broken out from the fixed price.
- C3
Tyler Technologies, Village of Downers Grove IL — our record of the clause: no test hours or fee anywhere; a test database is named and UAT appears on the project timeline, but no clause assigns test-script writing or execution to either party. MEDIUM rather than not assessable, because the stages are at least named.
The counter-example. PricewaterhouseCoopers LLP for Home Interiors & Gifts, Inc. (J.D. Edwards), July 2002 — the only contract of either paper type in which the integrator runs the test programme itself. Still the sole counter-example in the set.
What would make this finding weaker, stated for you rather than by you. The IBM fee table for NuVasive does list test-writing, execution and test-lead roles, with the hours against each redacted under an SEC confidential-treatment request rather than simply absent. The SAP America contract with Warnaco is a different shape again: SAP supports and provides guidance on the buyer’s acceptance testing rather than staying silent, though still no SAP hours are stated. Neither case is “no effort exists”. San Rafael and Sutter Creek, both Tyler Technologies, are not assessable for the same reason: each retrieved excerpt carries the identical data-conversion-verification sentence — the buyer “will be responsible for running reports and testing critical processes to verify the returned Data”
— and never reaches a clause assigning test-script writing or execution to either party. That same sentence appears a third time in the Downers Grove record, where it supports a MEDIUM finding rather than not assessable only because that record separately names a test database and a UAT line on the project timeline. It is the clearest illustration in the set of how close a MEDIUM and a not-assessable call sit on near-identical boilerplate.
What it means for a buyer. Testing effort that no one has priced does not disappear; it lands on the buyer’s own staff. Ask for implementer testing hours by stage, in writing, before signature. None of the thirteen contracts we could assess states them by stage.
Every contract shifts at least one risk with no matching consequence
C6 · 16 of 16
All sixteen supplier-written contracts contain at least one assumption that moves schedule or cost risk onto the buyer with no matching consequence for the supplier.
Assessable 16 of 16: fired 16. Vendor-direct 9 of 9; integrator-led 7 of 7. The only check in the set with a 100% fire rate, across 12 delivering parties, roughly 7 platform families and 24 years of documents.
- C6
Tyler Technologies, City of Sunrise FL and City of Sutter Creek CA: “We will not be liable for failure to meet any deadlines and milestones when such failure is due to … the failure by your personnel to provide such cooperation and assistance (either through action or omission)”
.
- C6
Tyler Technologies, City of San Rafael CA: “Implementation Hours included in this quote assume a work split effort of 70% Client and 30% Tyler”
.
- C6
SAP America, Inc., Warnaco Inc.: “the fees and timeline set forth herein shall be subject to change if the Licensee Responsibilities are not performed in a timely and appropriate manner”
.
- C6
Ciber Global, LLC, Wright County MN: “The Implementation occurs at a single physical site. The County is responsible for rolling out the use of the applications to other sites or remote offices”
— from the most buyer-protective integrator-led document in the set on every other check.
The counter-example. None. The nearest thing to one is the excluded buyer-drafted comparator.
What it means for a buyer. The asymmetry is the finding, not the assumption. Ask for each assumption to be paired with a buyer commitment someone has actually verified, and for a symmetric clause: supplier delay extends the schedule at no cost to the buyer.
Change management is excluded, unpriced, or handed to someone else
C4 · 10 of 15 assessable
Change management is excluded, unpriced or assigned elsewhere in 10 of the 15 contracts we could assess.
Assessable 15 of 16: fired 10, does not fire 5 because change management is a named, priced deliverable set. Not assessable 1 — Citizens Property Insurance (Applications Software Technology). By paper type: vendor-direct 8 of 9; integrator-led 2 of 6 assessable.
- C4
Workday, Inc., City of Orlando FL: “Change management, internal communications, testing, and training are outside the scope of this SOW, except to the extent expressly provided herein.”
The trailing exception matters: the exclusion is not absolute, and a buyer has to find what is expressly provided before assuming anything is covered.
- C4
Tyler Technologies, City of Rapid City SD: “Change Management Facilitator (TBD)”
— a role name, with no deliverable list anywhere against it.
- C4
SAP America, Inc., Warnaco Inc.: “Warnaco shall retain ownership and responsibility for the timely delivery of the organizational change management function”
.
The counter-examples — five contracts show it can be bought. Graviton Consulting for Weber County UT, with eight named change-management deliverables on a Prosci ADKAR basis. Tyler Technologies for the City of Sunrise FL, where “Change Management Self Service” is priced at $20,000 — the one vendor-direct document in the set that prices it. PricewaterhouseCoopers for Home Interiors & Gifts, with named training and communications deliverables. Collaborative Solutions (Cognizant) for the City of Chandler AZ, with a change-management strategy readout, a champion network, a communications plan and adoption reporting. And Ciber Global for Wright County MN, the first public-sector integrator-led counter-example in the set: a named Change Management Plan, Communication Plan and Change Readiness Assessment Document are all listed deliverables.
What it means for a buyer. A role name is not a deliverable. Ask for a priced deliverable set invoiced by milestone.
Post-go-live support ends before the first month-end close
C5 · 10 of 13 assessable
Post-go-live support ends before the buyer’s first month-end close, or is never defined at all, in 10 of the 13 contracts we could assess.
Assessable 13 of 16: fired 10, does not fire 3. Not assessable 3 — Sunrise FL (Tyler, exhibit truncated before the post-live section), NuVasive (IBM, the go-live and support section redacted in full) and Warnaco (SAP America, timeline exhibit not retrieved). By paper type: vendor-direct 6 of 7 assessable; integrator-led 4 of 6 assessable.
- C5
PowerSchool Group LLC, Utah State Board of Education: “the Postproduction Support period will begin at Go-Live and conclude in thirty (30) business days, i.e., one (1) month, unless otherwise stated.”
- C5
Ciber Global, LLC, Wright County MN: “Ciber will provide 30 Days Post Go-Live for HCM and ERP (remote)”
— a calendar window with no tie to a close, and 30 days does not reach two production payroll cycles.
- C5
Accenture LLP, P. H. Glatfelter Company: “Following the go-live, Accenture will continue to provide support … with the aim of handing over support completely to P. H. Glatfelter within a period of 3 months”
— an internal aspiration, not tied to a close.
The counter-examples. Collaborative Solutions (Cognizant) for the City of Chandler AZ, where hypercare is defined by function and event, covering two production payroll cycles and the first period-end close. And PricewaterhouseCoopers for Home Interiors & Gifts, where support runs past both the year-end and the first month-end close.
What it means for a buyer. A support period measured in business days is measured in the wrong unit. Define hypercare by function and event, with named staff, and check the go-live date against your own close calendar.
Data work is the buyer’s, with no conversion hours priced against it
C1 · 8 of 14 assessable
Data extraction, cleansing or validation is the buyer’s job with no implementer conversion hours priced against it in 8 of the 14 contracts we could assess.
Assessable 14 of 16: fired 8, does not fire 6 because an identifiable protective clause stops it. Not assessable 2 — Citizens Property Insurance (Applications Software Technology) and Warnaco (SAP America). By paper type: vendor-direct 4 of 8 assessable; integrator-led 4 of 6 assessable.
- C1
Workday, Inc., City of Orlando FL: “Workday does not provide a service to extract data”
.
- C1
IBM Global Business Services, NuVasive, Inc.: “NuVasive will be responsible for any data cleansing required to convert legacy system data.”
The counter-examples. Six documents do not fire, because a protective clause stops the check. Tyler Technologies priced conversions at a fixed fee per object and gated payment on the buyer’s acceptance in three separate contracts — Downers Grove, invoiced half on delivery and half “upon Client acceptance to load the converted Data into Live/Production environment”
, and Sutter Creek and Sunrise on materially the same acceptance-gated structure. PricewaterhouseCoopers listed data conversion as its own service for Home Interiors & Gifts. Infor develops the conversion strategy itself for Portland BES. And Ciber Global for Wright County MN is a genuinely new shape — “Ciber has allocated up to 480 hours for this effort”
, the first example in the set of an integrator stating its own conversion hours directly, even though extraction and cleansing remain the County’s job.
What it means for a buyer. Conversion is where the AI case usually dies: there is no useful model sitting on top of master data nobody has agreed to clean. Ask for conversion itemised by object, with implementer hours or a fixed fee per object, and payment gated on your acceptance to load into production.
Interfaces are counted and priced before anyone has designed them
C2 · 9 of 13 assessable
Integrations are listed by name or count with no design deliverable, no field mapping and no hours or fee per interface, in 9 of the 13 contracts we could assess.
Assessable 13 of 16: fired 9, does not fire 3 because a protective clause stops it, and 1 where the topic is absent entirely (the Sutter Creek contract states no interfaces or customisations are in scope, so there is nothing to count). Not assessable 3 — San Rafael (Tyler), Citizens Property Insurance (Applications Software Technology) and Warnaco (SAP America). By paper type: vendor-direct 5 of 7 assessable; integrator-led 4 of 6 assessable.
- C2
Collaborative Solutions (Cognizant), City of Chandler AZ: “integration estimates will be reviewed at completion of Architect & Configure stage. Adjustments may be required”
.
- C2
Ciber Global, LLC, Wright County MN — our record of the clause: “Ciber will activate up to eight (8) Wright County Interfaces to Oracle Cloud”
, with no per-interface design deliverable priced separately, and “The County has decided not to procure Integration cloud service…It will be the County’s responsibility to coordinate the extract/upload data from/to legacy systems.”
The counter-example. Accenture LLP for P. H. Glatfelter Company, January 2001: a stated count of 66 legacy interfaces with Accenture-owned functional design specifications — a designed inventory rather than a counted one.
What it means for a buyer. A number without a design is an estimate wearing a price tag. Ask for a named interface inventory with an implementer-owned design document per interface, and a rule for what happens to interfaces discovered after design.
The quoted fee, and who is allowed to change it
C10 · 6 of 12 · C7 · 6 of 15
In 6 of the 12 contracts we could assess on the point, the quoted fee is contractually only an estimate with no cap. In 6 of the 15 we could assess, the supplier holds a right to re-price or re-baseline that the buyer does not hold in return.
C10 (fee is contractually an estimate), assessable 12 of 16: fired 6, does not fire 6. Not assessable 1 — Warnaco (SAP America, fees exhibit not retrieved); never run against 3 — Rapid City, San Rafael, Portland BES. Vendor-direct 3 of 5 assessable; integrator-led 3 of 7. C7 (unilateral re-pricing), assessable 15 of 16: fired 6, does not fire 7, topic absent 2. Not assessable 1 — Warnaco. Vendor-direct 5 of 8 assessable; integrator-led 1 of 7.
- C10
PowerSchool Group LLC, Utah State Board of Education: “Notwithstanding any other provision of these terms, the timeline and total hours contained in this SOW shall be regarded only as estimates.”
- C7
Tyler Technologies, City of San Rafael CA: “Should portions of the scope… be altered by the Client, Tyler reserves the right to adjust prices for the remaining scope”
.
- C10
Ciber Global, LLC, Wright County MN — a counter-example rather than a red flag: “This is a fixed price SOW. Charges over the fixed price amount will require a change order”
.
The counter-examples. Tyler Technologies for the Village of Downers Grove IL: a not-to-exceed price backed by a completion guarantee. Ciber Global for Wright County MN: a fixed price with a buyer-protective, defer-by-default change-order mechanism.
What it means for a buyer. Ask two separate questions and get both answers in writing. Is this a price, a cap, or an estimate? And can the other party change it without my signature?
One contract in sixteen gets all four of the expensive things right — and it was signed in July 2002
cross-cutting · 1 of 16
Implementer-owned data conversion, an implementer-led test programme, change management as a named priced deliverable set, and post-go-live support past the first month-end close — all four in the same document.
One of the 16 supplier-written contracts can be shown to carry all four: PricewaterhouseCoopers LLP for Home Interiors & Gifts, Inc., July 2002. Where a governing exhibit could not be retrieved, we cannot say a document would have failed on all four — only that it cannot be shown to pass.
What it means for a buyer. This is the finding we would least like to be true and will not soften: the most protective ERP services contract in this set is 24 years old. The four things are not unobtainable. They were obtained, by a private buyer, before most of the current delivery methods existed.
Each finding above is also recorded row by row, with the quoted clause and the section reference where our record captured one, in the open dataset.