Slide 1: Welcome to CPARS Contractor Performance Assessment Reporting System Training www.cpars.gov Slide 2: Instructor Information Slide 3: Welcoming Remarks – Logistics - Breaks - Facilities Slide 4: Agenda - Policy - Workflow: Contract Registration - Ratings and Narratives - Workflow: CPAR Initiation – Closure - Reports, Helpful Hints and CPAR Strategies -Federal Awardee Performance and Integrity Information System (FAPIIS) - Past Performance Information Retrieval System (PPIRS) - Focal Point Session (Optional) Slide 5: What is CPARS? - Contractor Performance Assessment Reporting System (CPARS) - Web-enabled application that collects and manages a library of automated contractor report cards. - Four Modules within CPARS - CPARS (Services, IT, Operations Support, and Systems) - ACASS (Architect - Engineer Evaluations) - CCASS (Construction Evaluations) - FAPIIS (Collects Grantee and Contractor Performance and Integrity Information) Slide 6: Why Evaluate Contractor Performance? - Office of Federal Procurement Policy and Federal Acquisition Regulations Require: - Collection and Maintenance of Past Performance Information (PPI) for Use in the Award Decisions for Competitive Acquisitions Slide 7: Regulatory Requirements - FAR 42.1502 and 42.1503: Agencies Shall Prepare an Evaluation of Contractor Performance and Submit to Past Performance Information Retrieval System (PPIRS) - FAR 15.304: Past Performance Shall be Evaluated in All Source Selections for Negotiated Competitive Acquisitions - Acquisition Regulation Supplements: CPARS Shall be Used to Prepare Contractor Performance Evaluations - Acquisition Regulation Supplements: PPIRS Shall be Used as a Source of Past Performance Information in Source Selections Slide 8: CPARS Guidance (https://www.cpars.gov/cparsfiles/cpars/refmatl.htm) - Guidance - Applicability and Scope - Responsibilities Assigned - Frequency and Types of Reports - Administrative Information - Reports - References - Business Sectors - Rating Definitions - Instructions for Completing Forms - Available at CPARS web site under Reference Material link. Slide 9: Need for Improvement - Office of Federal Procurement Policy (OFPP), Government Accountability Office (GAO), and Department of Defense Inspector General (DoDIG) Reviews/Audits - Eligible Contracts Not Being Registered in CPARS - Performance Reports Not Being Entered in CPARS in a Timely Manner - Narratives of Insufficient Detail to Show that Ratings are Credible and Justified - Need to improve quantity and quality of information available in PPIRS so that source selection officials have greater confidence in reliability & relevance of information there - This class will help you avoid these pitfalls. Slide 10: Past Performance Process Overview - Government Program Manager and Contractor Representative Prepare Report Cards in CPARS - Completed Report Card is Passed from CPARS to PPIRS - Government Source Selection Officials and Contractor Senior Management Retrieve Report Cards from PPIRS Slide 11: CPARS Primary Objectives - Support Best Value Source Selection Decisions – Awards for Proven Performers (FAR 15) - Provide Up-to-Date Documentation of Contractor’s Ability to Meet Requirements (FAR 42) - Motivate Improved Performance - Facilitate Government – Contractor Communication - Determine Prospective Contractor Responsibility (FAR 9) Slide 12: CPAR Evaluations - Treated as Source Selection Information IAW FAR 3.104 - Pre-Decisional in Nature - Protected Throughout Life Cycle - Accessible By: - Government Personnel with Need to Know - Contractor who is Subject of Evaluation - May Not Be Transmitted Via Email - Retained for 3 Years After Contract Completion in PPIRS Slide 13: CPARS & Communication - Is CPARS and Effective Tool for Improving Government-Contractor Communication? - Yes! - Government: 92% - Contractor: 98% Slide 14: Federal Reporting Thresholds (FAR 42.1502) - Evaluations Required If: - Dollar Threshold - 1. Contracts > SAT* $150,000 - 2. Orders (Placed Against Federal Schedules/GWAC/MAC) >SAT* $150,000 - *Simplified Acquisition Threshold - Government may choose to write a CPAR on contracts below the dollar thresholds. Slide 15: CPARS DoD Reporting Thresholds* - Systems >$5,000,000 - Ship Repair & Overhaul >$500,000 - Services >$1,000,000 - Health Care >$150,000 - Operations Support >$5,000,000 - Fuels >$150,000 - Information Technology >$1,000,000 - Government may choose to write a CPAR on contracts below the dollar thresholds. Slide 16: Business Sectors - Systems - Aircraft - Shipbuilding - Space - Ordnance - Ground Vehicles - Training Systems - Sub-Systems -Science and Technology Slide 17: Business Sectors - Services - Professional/Technical/Management Support - Facilities Services - Repair & Overhaul - Transportation -Science and Technology Slide 18: Business Sectors - Operations Support - Spares - Repair Parts - Electronics - Ammunition - Mechanical - Electrical - Structural - Personnel Support - Facilities Supplies - Commercial Off the Shelf -Vehicles and Related Equipment Slide 19: Business Sectors - Information Technology - Software - Hardware - Telecommunications Slide 20: Important! - Evaluate Prime Contractor Performance Only - Do Not Evaluate Subcontractor Performance - Privity of Contract Between Prime-Sub - Acknowledge Subcontractor Effort - Critical Aspect or 25% or More of Effort - Include Sub’s Name and DUNS - Address in Narrative - Subcontract Management (Systems) - Business Relations (Nonsystems) Slide 21: Reporting Frequency - Contract Year 1: Interim Report - Contract Year 2: Interim Report - Contract Year 3: Final Report - Contract Year 3.5: Addendum Report (Optional) - Perform Accuracy Check Slide 22: Reporting Frequency - First Initial Report - Required if Period of Performance >365 Calendar Days - Not Required if Period of Performance <365 Calendar Days - Write Final CPAR Only - No More Than 12 Months of Actual Performance - Assessment Period May Begin After Contract Award Date - Protests - Delayed Starts (Note in Effective Date) Slide 23: Reporting Frequency - Interim Reports - Required Every 12 Months - Update with Other Reviews - Option Exercise - Award Fee Determinations - Program Milestones - Required Upon - Change in Program/Project Management Responsibility - Transfer of Contract, BOA, BPA to a Different Contracting Activity - Shall Be Started Prior to Transfer of AOR or AO - Not Cumulative: Assess Only Performance Occurring After Last Evaluation Period Slide 24: Reporting Frequency - Final Report - Required at Contract Completion - Delivery of Final Major End Item - End of Period of Performance - Required Upon Contract Termination - Not Cumulative: Assess Only Performance Occurring After Last Evaluation Period Slide 25: Reporting Frequency - Addendum Report - Evaluate Contract Close-Out - Evaluate Warranty Performance - Evaluate Performance with Respect to Other Administrative Requirements - Written at Government’s Discretion Slide 26: Reporting Frequency - All CPARs Are Due Within 120 Calendar Days After the End of the Evaluation Period Slide 27: Contract Types: Single Agency Indefinite-Delivery Contracts & Blanket Purchase Agreements (BPAs) - On Each Order - Contract 1 Order 1 = CPAR 1 - Contract 1 Order 2 = CPAR 2 - Contract 1 Order 3 = CPAR 3 - Orders Not Similar in Scope Slide 28: Contract Types: Single Agency Indefinite-Delivery Contracts & Blanket Purchase Agreements (BPAs) - One CPAR at Basic Contract/Agreement Level Covering All Orders Under Contract/Agreement - Contract 1 Order 1, Contract 1 Order 2, Contract 1 Order 3 = CPAR 1 - Orders Similar in Scope Slide 29: Contract Types: Single Agency Indefinite-Delivery Contracts & Blanket Purchase Agreements (BPAs) - On Each Order Meeting Threshold & Combining All Other Orders Into One CPAR - Contract 1 Order 1 (SAT) = CPAR 2 -Slide 30: Contract Types: Basic Ordering Agreements (BOAs) - Individual CPAR for Each Order Above Threshold - See Local Policy for Additional Details Slide 31: Contract Types: Federal Supply Schedules/GSA Orders, Multi-Agency Contracts (MACs), & Government-Wide Award Contracts (GWACs) - Requiring Activity/Ordering Agency Prepares CPAR - Best Position to Evaluate Performance - Individual CPAR for Each Order Above Threshold - Each Order Reported Individually Slide 32: Contract Types: Federal Supply Schedules/GSA Orders, Multi-Agency Contracts (MACs), & Government-Wide Award Contracts (GWACs) - Contract Number = GSA Schedule # / MAC #/ GWAC# (Required) - Order Number = Local Order Number (Required) - Screenshot: Register/Update a Contract Screen Slide 33: Contract Types: Joint Venture - Single CPAR Prepared if Unique DUNS Number/CAGE Code Assigned Slide 34: Contract Types: Science and Technology, Research and Development - Federal – CPAR Required - DoD – Exempt From CPARS Reporting - R&D Budget Accounts 6.1, 6.2, 6.3 Slide 35: Contract Types: Canadian Commercial Corporation (CCC) - CPAR Written on CCC - CCC is Prime Contractor with Overall Responsibility for Performance - List Canadian Subcontractor on CPAR (Block 15) - Canadian Subcontractor Performs Actual Work - Include DUNS & CAGE Slide 36: Contract Types: AbilityOne Program - CPAR Required on Award Under AbilityOne Program if Meets Threshold - DoD-CPAR Required -Federal-Exempt From CPARS Slide 37: Contract Types: Classified & Special Access Programs - CPARs for Classified Programs NOT Entered Into CPARS Automated System - CPAR Processed in Accordance with Program Security Requirements - CPAR Maintained and Distributed in Accordance with Agency Procedures Slide 38: Contract Types: Undefinitized Contract Actions (UCAs) - Prior to Definitization - Address Performance Beginning with Date UCA Issued - Address Contractor’s Ability to Remain within UCA Cost Limitations - Following Definitization - Address Contractor’s Efforts in Promoting Contract Definitization - If Definitized as Cost-Type Contract – Continue to Address Cost Control - If Definitized as Firm-Fixed-Price Contract – Only Address Cost Control Efforts Prior to Definitization Slide 39: Logging In - DoD Users - User ID Required - PKI Certificate Required (CAC Card) - Non-DoD Users - User ID Required - Password Required - Contractor Users - User ID Required - PKI Certificate Encouraged - Purchase from External Certificate Authority - Password Required if No PKI Certificate - No PKI = Password Slide 40: Logging In - Screenshot: CPARS Homepage - 1. Visit https://www.cpars.gov Slide 41: Logging In - Screenshot: CPARS Homepage - 2. Select CPARS Slide 42: Logging In - Screenshot: CPARS Page - 3. Select CPARS Logon Slide 43: Logging In - Screenshot: PKI Screen - Screenshot: Login Screen - First Time Logging In? Use the Forgot Password button to receive an email with a temporary password. -Forgot your User ID? Use the Forgot User ID button to receive and email with your User ID. Slide 44: Accessing CPARS - Screenshot: Module Selection Menu - 1. After Logging in with USER ID, Select CPARS Module Slide 45: Focal Point/Alternate Focal Point - Assign Players Access - May Determine Contracts Requiring CPARs - Registers Contracts - Educate and Assist Users - Provide Guidance to Contractors - Government Only! Slide 46: Additional User Roles - Assessing Official (AO) – Writes Eval, Reviews Contractor Comments (Required) - Contractor Rep (CR) – Provides Comments (Required) - Reviewing Official (RO) – Resolves Disputes (Required Only for Disagreements) - Contract Data Entry (CDE) – Registers Contract (Optional) - Assessing Official Rep (AOR)- Assists AO in Drafting Eval (Optional) Slide 47: Enter Proposed Ratings - Assessing Official Rep Examples - Technical Experts - Contract Specialists - Contracting Officer - Contracting Officer’s Representative - Task/Order Monitor - For Civilian Agencies, generally someone in Requirements Community. For DoD, generally someone from Contracting. - Government Only! Slide 48: Enter Proposed Ratings - Assessing Official Examples - The Person Responsible for the Execution of the Program, Project, Order - Program Manager or Equivalent - IPT Lead - Performance Evaluator - Quality Assurance Evaluator - Requirements Indicator - Contracting Officer’s Representative - Technical Team Requirements Personnel - Product/Service End User - Contracting Officer - For Civilian Agencies, generally someone in Contracting. For DoD, generally someone from Requirements Community. - Government Only! - Note: Be sure to review local policy guidance regarding assignment of the Assessing Official function. Slide 49: Focal Point - Assigns Roles, Players, and Email Addresses to Contract Numbers Slide 50: CPARS Workflow - Contract Registration - A. Focal Point Assigns Users - B. Contract is Registered - Automated: Focal Point - Manual: Focal Point, Contract Data Entry, Assessing Official, Assessing Official Rep - Enter Proposed Ratings - Validate Proposed Ratings - Contractor Comments - Review Contractor Comments - Reviewing Official Comments Slide 51: Contract Registration (Automated) - Requirements - Focal Point Only - Auto Register Within 30 Calendar Days of Contract Award - Auto Register ONCE per Contract Duration - Must Complete Organization Field - Primary Method of Registration Slide 52: Contract Registration (Manual) - Requirements - Register Within 30 Calendar Days of Contract Award - Register ONCE per Contract Duration - Enter Basic Contract Information - Must Complete Mandatory Fields - Note: Be sure to review local policy guidance regarding assignment of the Contract Registration function. Slide 53: Navigating CPARS - Icons - * Denotes Mandatory Entry - ? Denotes Help Button - Calendar Button - Lookup Button - Navigation Tab Buttons Slide 54: Manual Registration - Screenshot: Assessing Official Rep Entry Main Menu - 1. Select Register/Update a Contract - 2. Enter Contract Number & Order Number (if applicable) - These steps are also used to update contract registration records. Slide 55: Manual Registration - Screenshot: Enter Company Information - 1. Enter CAGE, DUNS, or Company Name - Screenshot: Select Company - 2. Select Company by Clicking on DUNS Slide 56: Manual Registration - Screenshot: Contractor Name/Address Tab - Company Information Pulled in From System for Award Management (SAM) Slide 57: Manual Registration - Screenshot: Contract Information Tab Slide 58: CPARS Workflow - Contract Registration - Enter Proposed Ratings - Assessing Official Rep(s), Assessing Official - Validate Proposed Ratings - Contractor Comments - Review Contractor Comments - Reviewing Official Comments Slide 59: Enter Proposed Ratings - Requirements - Develop a Comprehensive Contract Effort Description (Block 17) Slide 60: Contract Effort Description - Complete Effort Description Identifying: - Key Technologies - Components - Subsystem Requirements - Complexity of Contract - Acronyms - Technical Terms - Critical to Future Performance Risk Assessment Groups and Source Selection Authorities - Note Scope Changes Since Prior Evaluation Slide 61: Sample Contract Effort Description The contractor provides maintenance and support of VFED for the General Services Administration. - Sufficient? Yes or No Slide 62: Sample Contract Effort Description - Not Sufficient - Missing - Detail of Scope - Complexity of Contract - Key Technologies - Definitions of Acronyms and Technical Terms Slide 63: Sample Contract Effort Description - Sufficient The Contractor provides maintenance and technical support for General Services Administration’s Very Fancy Engine Database (VFED). VFED manages 24,000 engines and nearly 2 million serially tracked, life-limited, critical engine parts and components supported and maintained on a daily basis. This database is used for asset tracking, inventory management, tracking hours in flight, maintenance and repair records, warranty information, parts lists, and engine configuration. The contractor is responsible for maintenance of the Oracle database and Apache software. VFED was developed by the previous incumbent. The contractor is responsible for requirements analysis, upgrades, configuration management, and help desk technical support. Support during this assessment period included two system upgrades and approximately 5000 help desk requests. Slide 64: Elements Assessed - Systems -Technical (Quality of Product) - Product Performance - System Engineering - Software Engineering - Logistics Support/Sustainment - Product Assurance - Other Technical Performance - Schedule - Cost Control Slide 65: Elements Assessed - Systems (Cont.) - Management - Management Responsiveness - Subcontract Management - Program Management and Other Management - Small Business Utilization - Other Areas Slide 66: Elements Assessed - Nonsystems - Quality of Produce or Service - Schedule - Cost Control - Business Relations - Small Business Utilization - Management of Key Personnel - Other Areas Slide 67: Enter Proposed Ratings - Requirements - Enter Proposed Ratings & Narratives (Blocks 18 and 20) - 24,000 Character Limit - Current Ratings - Changes From Past Ratings - Trends Slide 68: Ratings and Narratives - Narratives are the most important part of the CPAR! Slide 69: Rating Definitions Slide 70: Rating Definitions - Rating: Satisfactory - Contract Requirements: Meets All - Problems: Some Minor - Corrective Actions: Satisfactory Slide 71: Rating Definitions - Rating: Very Good - Contract Requirements: Exceeds Some – Government Benefit - Problems: Some Minor - Corrective Actions: Effective Slide 72: Rating Definitions - Rating: Exceptional - Contract Requirements: Exceeds Many – Government Benefit - Problems: Few Minor - Corrective Actions: Highly Effective Slide 73: Rating Definitions - Rating: Marginal - Contract Requirements: Does Not Meet Some - Problems: Serious; Recover Still Possible - Corrective Actions: Marginally Effective; Not Fully Implemented Slide 74: Rating Definitions - Rating: Unsatisfactory - Contract Requirements: Does Not Meet Most - Problems: Serious; Recovery Not Likely - Corrective Actions: Ineffective Slide 75: Ratings and Narratives - Narrative Guidelines - Address Contractor Performance - Recent - Relevant - Collect Input From Entire Program/Project Team - Provide Reader a Complete Understanding of the Contractor’s Performance - Must Be: - Accurate - Fair - Comprehensive Slide 76: Ratings and Narratives - Narrative Guidelines - Narrative Required for Each Rated Element - Address - Rating Changes From Prior Reports - Benefit/Impact to Government - Recognize - Risk Inherent in Effort - Government’s Role in Contractor’s Inability to Meet Requirements - Indicate Major/Minor Strengths/Weaknesses Slide 77: Ratings and Narratives - Narrative Guidelines - Consistent With - Program Metrics - Program Reviews - Earned Value Management (EVM) Data - Award Fees/Incentives - Certificates of Service - Cost Performance Reports - Quality Reviews/Evals - Ratings - Contract Objectives - Document Problems and Solutions - Contain Non-Personal and Objective Statements Slide 78: Sample CPAR Narratives - Elements Assessed - Quality - Schedule - Cost Control - Business Relations Slide 79: Quality of Product or Service - Assess Conformance to: - Contract Requirements - Specifications - Standards of Good Workmanship - Are reports/data accurate? - Does the product or service meet the specifications of the contract? - What degree of Government technical direction was required to solve problems that arose during performance? Slide 80: Sample CPAR Narrative - Element Assessed: Quality Quality – Rating: Exceptional The contractor is exceptional. They continue to provide high quality support and database services. - Sufficient? Yes or No Slide 81: Sample CPAR Narrative - Not Sufficient - Missing - Detail to Support Rating - Detail to Tell Entire Story - Supporting Documentation/Metrics Slide 82: Sample Narrative - Sufficient Quality – Rating: Exceptional Contractor has provided exceptional quality in support of VFED. Contract required a system backup and disaster recovery plan that was put to test after a malicious code/virus attack. Contractor was proactive with a successful recovery, implemented an innovative solution to prevent future attacks, and enhanced system security. The contractor also initiated a system analysis identifying a security loophole previously overlooked at the time of database development by the previous incumbent. The contractor was able to recommend a Commercial-Off-The-Shelf (COTS) product to resolve security issues saving custom development time and cost. The contractor staff assisted in conducting analysis of alternatives, market research, and application acquisition package recommendations in finding the COTS bolt-on. Contractor experienced report generation errors resulting in unscheduled down time after a three week period, however, resolved the performance issue by scheduling report runtime during times of minimal system usage and optimized the reports to require less memory. Slide 83: Schedule - Assess Timeliness of Completion Against: - Contract - Task Orders - Milestones - Delivery Schedules - Administrative Requirements Slide 84: Sample CPAR Narrative - Element Assessed: Schedule Schedule – Rating: Very Good In our opinion, the contractor has done really well in terms of schedule. The Systems Security Manager, Jack Jones is pleasant and easy to work with. He adapts to our schedule changes amazingly and never complains. He also went above and beyond and assembled our Smart Board and projector without charging the government and he continued to meet all the contract objectives in the interim. Great job! - Sufficient? Yes or No Slide 85: Sample Narrative - Not Sufficient - Missing - Detail to Support Rating - Supporting Documentation/Metrics - Additional Issue: - Using Individual’s Name - Outside Contract Scope - Subjective Phrases Slide 86: Sample Narrative - Statements to Avoid - Outside Contract Scope - In Our Opinion - It Appeared - We Believe - We Hope - We Were Not Happy - We Did Not Like - We Think Slide 87: Sample Narrative - Sufficient Schedule – Rating: Very Good Contractor successfully executed system recovery, exceeding requirements, and deployments of new releases were on schedule for this period. Per the Continuity of Operations Plan (COOP) the contractor had a 7 day timeframe for full restoration after sustaining the attack, but was able to recover and bring on-line within 4 days resulting in cost and time benefits for not having to manually track data. This early recovery eliminated a work stoppage on engine configuration management at the customer sites. The contractor experienced a turnover with the senior developer during a development phase of the first upgrade, however, due to a replacement with a highly skilled senior developer that was able to program more quickly and efficiently, the contractor was able to bring the final release deployment back on track and no impact to the schedule. Slide 88: Cost Control - Assess Effectiveness in Forecasting, Managing, Controlling Contract Cost - Does the Contractor keep within the total estimated cost? - Negotiated/Budgeted Costs Versus Actuals - Did the Contractor do anything innovative that resulted in cost savings? - Were billings current, accurate, and complete? - Are the Contractor’s budgetary internal controls adequate? Slide 89: Sample CPAR Narrative - Element Assessed: Cost Contol Cost Control – Rating: Satisfactory The contractor works well on budget items and only encountered minimal issues with cost reporting. They always do a great job working with the government. - Sufficient? Yes or No Slide 90: Sample CPAR Narrative - Not Sufficient - Missing: - Detail to Support Rating - Supporting Documentation/Metrics - Additional Issues: Subjective Phrases Slide 91: Sample CPAR Narrative - Sufficient - Cost Control – Rating: Satisfactory The contractor is currently on budget despite some cost allocation issues. The contractor is required to provide funds and man-hour expenditure reports for preceding monthly activity by the 10th of each month. The contractor’s accounting system experienced cost allocation issues with senior developer charges while working multiple programs. The government observed an unusually high burn rate for the senior developers and requested a contractor internal audit. Audit findings proved that during a 2-month period, hours were improperly allocated to this contract while the performance was conducted on a different contract. Corrective actions have been successful as senior developers were retrained on proper charging procedures, modifications were done to the accounting system to track cost with an increased level of granularity, and invoices were corrected to reflect actual work time. The contractor continues to provide required work within the cost ceiling. Slide 92: Business Relations - Assess Integration and Coordination of All Activity Needed to Execute Contract - Problem Identification - Corrective Action Plans - Reasonable & Cooperative Behavior - Customer Satisfaction - Timely Award & Management of Subcontracts Slide 93: Sample CPAR Narrative - Element Assessed: Business Relations Business Relations – Rating: Marginal The Contractor has exhibited marginal performance during this reporting period. The subcontract for Tier-1 Help Desk support was awarded 4 weeks later than required in the 30-day transition period between the previous incumbent and the contractor, resulting in funding increases while utilizing junior developers to provide Tier-1 Help Desk support during the time lag. The Help Desk experienced a high turnover in personnel with insufficient time to adequately train new hires. In addition, contract maximum response time for customer calls and emails is ½ day for Tier-1 support; monthly statistics provided by the contractor indicated a 3-4 day average. This issue was addressed in the quarterly program review and corrective actions to date have been marginally successful. Six months after the review, the contractor implemented an aggressive recruiting and training program reducing response time to 2-3 days; a noted improvement, however, still not within contract requirements. Slide 94: Sample CPAR Narrative - Sufficient - Detail to Support Rating - Documentation/Metrics - Corrective Actions - Objective Language Slide 95: Ratings and Narratives Utilization of Small Business Rating Definitions Rating: Exceptional Subcontracting Plan: Met All Goals & Exceeded at Least One ISR/SSR: Accurate & Timely Benefits/Impacts: Multiple Significant Events of Benefit Rating: Very Good Subcontracting Plan: Met All Traditional Goals & at Least One Other Goal ISR/SSR: Accurate & Timely Benefits/Impacts: Significant Event of Benefit Rating: Satisfactory Subcontracting Plan: Good Faith Effort to Meet Goals ISR/SSR: Accurate & Timely Benefits/Impacts: Minor Problems; Major Problems with Corrective Action Rating: Marginal Subcontracting Plan: Deficient in Meeting Key Plan Elements ISR/SSR: Inaccurate; Untimely Benefits/Impacts: Corrective Action Plan Required Rating: Unsatisfactory Subcontracting Plan: Noncompliant; Uncooperative ISR/SSR: Inaccurate; Untimely Benefits/Impacts: Multiple Significant Problems; Liquidated Damages Slide 96: Utilization of Small Business - Assess Compliance with Small Business Participation Goals - Were small businesses given meaningful, innovative work directly related to the project? - Were Individual Subcontract Reports (ISRs) or Summary Subcontract Reports (SSRs) accurate and timely? Slide 97: Utilization of Small Business - Federal Supply Schedule and Multi-Agency Contract – Not Assessed for Individual Orders - Single Agency Contract, BPA, BOA – If CPAR is Reported at Delivery/Task Order Level, Not Assessed Unless Required by the Contracting Officer - Evaluation of Subcontract May Be Addressed in Narrative (Block 20) Slide 98: Sample Narrative Utilization of Small Business – Rating: Exceptional The Contractor exceeded their 27% small business goal by 2 percentage points and met all of the other subcontracting goals. The contractor awarded a subcontract to a small business for mission critical information technology for this program. The contractor conducted three outreach events which directly led to award of subcontracts to Service Disabled Veteran Owned small businesses and HUBZone small businesses. The contractor exceeded the small business participation requirements of the contract that required the small business to be used for 25% of the R&D portion of the contract, by awarding 50% of this requirement to small business. The contractor submitted all required reports on time. Contains: - Quantifiable Accomplishments - Comparison to Plan Goals - Type of Work Performed by SB Slide 99: Ratings and Narratives - Narrative Guidelines - Due to Nature of Work (Low Risk Activities) May be Difficult to Obtain Rating Above Satisfactory - Note this Fact in the CPAR Narrative Slide 100: Sample Narrative - Quality of Product or Service – Rating: Satisfactory This contract is for the collection of refuse at XXX Air Force Base located near Anytown, USA. As part of its services, Contractor XXX is required to pick up 87 dumpsters across an approximate 30 square mile area, 12 hazardous waste containers, and 7 bio- hazardous waste material containers at the Medical Clinic located at the base. Given the nature of the services performed for this contract and the schedule for refuse collection, it would be difficult to obtain above a Satisfactory rating for performance on this contract. During this evaluation period, Contractor XXX met all of its refuse collection requirements on time as stated in the contract. Further Contractor XXX ensured that all of the tops of the dumpsters were closed after dumping to ensure that no foreign object debris (FOD) entered the flight line area despite the locale being in an area prone to high winds. There were no incidents of improper storage or disposal of the hazardous waste or bio-hazardous waste material during this reporting period. Therefore, the rating of Satisfactory indicates performance within the requirements of the contract and that there were no problems encountered during this reporting period with Contractor XXX. Slide 101: Narrative Hints - Communication - Throughout the Performance Period - With Contractor and Within Government - Documentation - Record Significant Metrics/Events Throughout the Performance Period - “The CPAR Should Write Itself” - Create a Working CPAR - Draft On-Line - Draft Off-Line Document - Use Copy and Paste Slide 102: Ratings and Narratives - Bottom Line: Accurate and Complete CPARs Help Ensure Better Quality Products & Services! Slide 103: CPARS Workflow - Contract Registration - Enter Proposed Ratings - Assessing Official Rep(s), Assessing Official - Validate Proposed Ratings - Contractor Comments - Review Contractor Comments - Reviewing Official Comments Slide 104: Enter Proposed Ratings - Assessing Official Rep Requirements - Review Admin Info (Blocks 1 – 17) - Enter “Report Type” (Block 2) & Period of Performance (Block 3) - Initiate CPAR and Draft Evaluation (Blocks 18 & 20 Ratings & Narratives) - 24,000 Character Limit (approximately 4 pages) - Save and Pass to Another AOR (if applicable) - Send to Assessing Official Slide 105: Enter Proposed Ratings - Screenshot: Assessing Official Rep Main Menu - 1. Select Initiate a CPAR - 2. Enter Contract Number and Order Number (if applicable) Slide 106: - Screenshot: Contract Information Tab - Entering blocks 2 and 3 allows you to save and work from To Do List. Slide 107: - Screenshot: Misc. Information Tab Slide 108: - Screenshot: Small Business Utilization Tab Slide 109: - Screenshot: Ratings Tab Slide 110: - Screenshot: Assessor Tab Slide 111: CPARS Workflow - Contract Registration - Enter Proposed Ratings - Validate Proposed Ratings - Assessing Official - Contractor Comments - Review Contractor Comments - Reviewing Official Comments Slide 112: Validate Proposed Ratings - Assessing Official Requirements - Review Admin Info (Blocks 1 – 17) - Validate Ratings & Narratives (Blocks 18 & 20) - Modify Ratings & Narratives (if necessary) - Return to AOR for Corrections - 24,000 Character Limit (approximately 4 pages) - Name and Title (Block 21) - Send to Contractor Rep - Perform Quality Review Prior to Sending Slide 113: Validate Proposed Ratings - Screenshot: Assessing Official Main Menu - 1. Select To Do List - Screenshot: To Do List - 2. Select Contract from To Do List Slide 114: Validate Proposed Ratings - Screenshot: Assessor Tab Slide 115: CPARS Workflow - Contract Registration - Enter Proposed Ratings - Validate Proposed Ratings - Contractor Comments - Contractor Rep - Review Contractor Comments - Reviewing Official Comments Slide 116: Contractor Comments - Requirements - 30 Days to Respond - System Generated Weekly Email Notifications - 7 Calendar Days to Request Meeting to Discuss CPAR - Review Admin Info (Blocks 1 – 17), Ratings and Narratives - Provide Clear and Concise Responses (Block 22) - 24,000 Character Limit (approximately 4 pages) - Provide Concurrence/Non-Concurrence, Name & Title (Block 23) - Send to Assessing Official Slide 117: Contractor Comments - Contractor Guidance Included in Transmittal Email - Protect the CPAR - Handle as “Source Selection Information” - Prohibited Use - Advertising - Promotional Material - Pre-Award Surveys - Production Readiness Reviews - Advise Contractor to - Acknowledge Receipt - Comment - Respond Within 30 Calendar Days Slide 118: Contractor Comments - Screenshot: Contractor Rep Main Menu - 1. Select To Do List - Screenshot: To Do List - 2. Select Contract from To Do List Slide 119: Contractor Comments - Screenshot: Ratings Tab Slide 120: Contractor Comments - Screenshot: Contractor Rep Tab - If concur, AO may close. If non-concur, RO must close. Slide 121: CPARS Workflow - Contract Registration - Enter Proposed Ratings - Validate Proposed Ratings - Contractor Comments - Review Contractor Comments - Assessing Official - Reviewing Official Comments Slide 122: Review Contractor Comments - Assessing Official Requirements - Review Contractor Comments - Close CPAR - Modify CPAR - Send to Reviewing Official (if applicable) Slide 123: Review Contractor Comments - Workflow Note: If the Contractor fails to respond to the CPAR within 30 calendar days, the Assessing Official has the option to pull back the CPAR and close it. Slide 124: Review Contractor Comments - Screenshot: Assessing Official Main Menu - 1. Select To Do List. - Screenshot: To Do List - 2. Select Contract from To Do List Slide 125: Review Contractor Comments - Screenshot: Contractor Rep Tab - Contractor concurs. AO may close, modify, or send to RO. Slide 126: Review Contractor Comments - Screenshot: Contractor Rep Tab - Contractor does not concur. AO may modify or send to RO. Slide 127: Modify Ratings - Screenshot: Ratings Tab - Revised ratings appear on Modified Ratings tab. Original ratings appear on Original Ratings tab. Slide 128: CPARS Workflow - Contract Registration - Enter Proposed Ratings - Validate Proposed Ratings - Contractor Comments - Review Contractor Comments - Reviewing Official Comments - Reviewing Official Slide 129: Reviewing Official Comments - Required - If the CPAR is Contentious - If Local Policy Mandates - Note: Be sure to review local policy guidance regarding assignment of the Reviewing Official function. Slide 130: Reviewing Official Comments - Requirements - Review CPAR - Blocks 1 – 23 (read only format) - May Return to AO for Correction - Input Comments (Block 24) - Acknowledge Discrepancies Between Government Ratings/Narratives and Contractor Comments - 16,000 Character Limit (approximately 3 pages) - Name and Title (Block 25) - Close CPAR - Government Only! Slide 131: Reviewing Official Comments - Screenshot: Reviewing Official Main Menu - 1. Select To Do List. - Screenshot: To Do List - 2. Select Contract from To Do List. Slide 132: Reviewing Official Comments - Screenshot: Reviewer Tab Slide 133: CPARS Workflow - Contract Registration - Enter Proposed Ratings - Validate Proposed Ratings - Contractor Comments - Review Contractor Comments - Reviewing Official Comments - CPAR Sent to PPIRS Slide 134: Automatic Email Notices - Each Step of Workflow - System Reminders - Evaluation Due (Assessing Official, Assessing Official Rep, Alt./Focal Point) - 30 Days Prior - Helps Ensure Reports Completed On Time - Evaluation Overdue (Assessing Official, Alt./Focal Point, Reviewing Official (if finalized)) - Contractor Comments Due (Assessing Official, Contractor) - Contractor Comments Overdue /Review Period Expired (Assessing Official) - Evaluation Complete (Contractor) - Access Assignment (All Roles) Slide 135: Additional Roles - Department Point of Contact - CPARS Configuration Control Board - Agency Point of Contact - Higher Level for Monitoring - Contractor Corporate Senior Management Representative - CEO, President, CFO - Access Granted by DUNS Number Slide 136: Configuration Control Board - Controls System Configuration and Policy - Evaluates User Suggested Changes and Enhancements - “Submit Suggestion” in CPARS - Contact webptsmh@navy.mil - All suggestions will be considered! Slide 137: Reports - Keep Qualifiers/Parameters Simple - User Reports to Monitor Process - CPAR Status - Contract Status - User List - Activity Log - Spreadsheet - New! List of Users on Contract Status Report Slide 138: CPAR Status Report - Screenshot: Focal Point Main Menu - Screenshot: CPAR Status Parameters Slide 139: CPAR Status Report - Screenshot: CPAR Status Report - Add notes - Download into spreadsheet - View access list - View actions taken - Status Key Slide 140: Contract Status Report - Screenshot: Focal Point Main Menu - Screenshot: Contract Status Parameters Slide 141: Contract Status Report - Screenshot: Contract Status Report Slide 142: User Profile Menu/Switch Access Level - Change User Information - Update User Profile/Email - Critical to CPARS Automated Workflow - Required Annually - Change User Preferences - Select or De-Select Optional Email Notifications - Change Login Password (Non-PKI) - Forgot Password Button - May be Reset by Focal Point or CPARS Help Desk - Expire Every 60 Days and Must be Changed at Next Login - Switch Access Level Slide 143: User Profile Menu - Screenshot: Assessing Official Main Menu - Screenshot: User Profile Menu Slide 144: Switch Modules - Screenshot: Assessing Official Main Menu - Screenshot: Module Selection Menu Slide 145: Helpful Hints - Prior to Performance Period - Be Up Front - Identify Expectations - Discuss Areas to be Evaluated - Provide CPARS Guides to Contractors and Evaluators - During Post-Award Conference - Prior to Annual Evaluation - Leave Yourself Flexibility - Don’t wait until the annual evaluation to make your contractor aware of performance! Slide 146: Helpful Hints - During Performance Period - Communicate with Contractor - Provide Feedback - Document Performance Regularly - Status Reports - Earned Value Management Data - Monthly Certificates of Service - Award Fee Evaluations - Program Reviews - Earned Contract Incentives Slide 147: Helpful Hints - After Performance Period - Provide Contractor Draft Evaluation - Contractor May Provide Self Assessment - Take Time to Acknowledge Contractor Concerns - Face to Face Meetings - Extend 30 Calendar Day Comment Period if Necessary - Document File if no Contractor Comments Received - Transmittal Letter Email - Phone Conversation - Efforts to Contact Contractor Slide 148: Helpful Hints - Characteristics of a Lose-Lose CPAR - Use as a “Big Stick” - Solicit Out of Scope Work - Establish a Negotiation Position - Rate Government Program Manager - “Nobody Grades as Hard as I Do” - Document Performance Outside of Contract Slide 149: Helpful Hints - Characteristics of a Win-Win CPAR - Fair - Relevant - Comprehensive - Repeatable Process - Timely - Accurate - Consistent Slide 150: FAPIIS - Federal Awardee Performance & Integrity Information System (FAPIIS) - Contracting Officers Enter: - Non-Responsibility Determinations - Terminations for Cause - Terminations for Default - Defective Pricing - DoD Determination of Contractor Fault - Grant Officers Enter: - Recipient Not Qualified Determinations - Terminations for Material Failure to Comply - Suspension/Debarment Officials Enter: - Administrative Agreements - For Additional Information Reference FAR 9.105, 9.406-3, 9.407-3, 42.1503 and DFARS 209.105-2 Slide 151: Retrieve FAPIIS Records - Access PPIRS to: (www.ppirs.gov) - Support Source Selections - Access Integrity and Performance Information - Obtain Proceedings Information from the System for Award Management (SAM) - Obtain Suspension/Debarment Information from SAM - For Contractors, Enter Comments on FAPIIS Records - FAPIIS Public Website (www.fapiis.gov) - Excludes Performance Assessments - Includes Data After April 15, 2011 - 14 Day Data Delay, Excludes Grant Records (per FAR 9.105-2) - CCR and EPLS Information Available - FAPIIS Flowchart Slide 152: PPIRS - Past Performance Information Retrieval System - www.ppirs.gov Slide 153: PPIRS - Federal Repository for Completed Assessments - Contractor Performance Assessment Reporting System (CPARS) - Architect-Engineer Contract Administration Support System (ACASS) - Construction Contractor Appraisal Support System (CCASS) Slide 154: PPIRS - Access - Government - Go to www.ppirs.gov and Select “PPIRS System Logon” - Create an Account - Provide Justification for Access - Join Your “Group” - Contractor - Controlled through System for Award Management (SAM) - Identify a Marketing Partner Identification Number (MPIN) - DUNS and MPIN Become User ID and Password for PPIRS - View Completed Evaluations at www.ppirs.gov - Select “PPIRS System Logon” Slide 155: PPIRS - Screenshot: PPIRS Slide 156: PPI & Source Selections - Solicitation Should Address - Relevance (PPI for Similar Work) - Areas of Consideration (i.e., Technical, Management, Schedule, etc.) - Timeframe (Consider Last 3 Years) - Sources - Relative Importance - PPIRS - Contains Contractor Comments - No Need to Re-Address PPI - Rely if Believe PPI is Valid - Contractor Ensures Accuracy - Golden Rule: Evaluate PPI IAW Solicitation! Slide 157: Additional Information - Help Desk (Mon-Fri 6:30am-6:00pm EST) - Commercial: 207-438-1690 - Email: webptsmh@navy.mil - CPARS Web Site: (www.cpars.gov) - Click on CPARS Link - FAQ - Policy Guidance - Quality Checklist - User Manual - Training Information Slide 158: Next Steps - Evaluate All Eligible Contracts and Orders - Complete CPARs in a Timely Manner - Improve Detail and Quality of Narratives - Ratings Credible and Justified Slide 159: Why Evaluate Contractor Performance? Slide 160: Thank You! Slide 161: Focal Point Session Slide 162: Focal Point Session Agenda - Functions Overview - Automatic Contract Registration - User Access Matrix - Access Assignment - Modifying Access - Account Maintenance - Access Transfers - Alternate Focal Points Slide 163: User Profile: Select Organization Screen shot: User Information For New Focal Point Accounts: You will be required to select the Organization(s) over which you have cognizance. Slide 164: Contract Registration (Automated) - Requirements - Focal Point Only - Auto Register Within 30 Calendar Days of Contract Award - Auto Register ONCE per Contract Duration - Must Complete Organization Field - Primary Method of Registration Slide 165: Contract Registration (Automated) - Weekly Email Notifications - Contracts Auto Registered With No Users Assigned - Users Assigned to Contract Which Has Not Been Registered - Helpful Hint: Auto register contracts and assign users concurrently. Slide 166: Contract Registration (Automated) - Screenshot: Focal Point Main Menu - 1. Select Auto Register Contracts - Screenshot: Auto Register Contracts - 2. Enter Contract Office Code or Full/Partial Contract Number Slide 167: Contract Registration (Automated) - Screenshot: Auto Registration List - 1. Select Organization - 2. Select Contract(s) - 3. Click Register Slide 168: User Access Matrix - Determine Process Participants - Names - Email Addresses - Minimum Required Roles - Assessing Official - Contractor Representative - Reviewing Official (If Contentious) - Optional Roles - Contract Data Entry (If Manual Registration) - Assessing Official Representative - Reviewing Official (If Not Contentious) - Helpful Hint: Ask Contracting Officer or Requiring Office to provide User Access Matrix Slide 169: Access Assignment - Access Authorization - Create New User Access - Enter or Select Contract(s) - Select User Role - Enter User Name - Enter New User Name & Email Address - Select Existing User - Create User Access Matrix - Automatic Email Notifies Users of Access Assignment - User ID - User Forgot Password Function if New User (Non-PKI) - Synopsis of User Role - Helpful Hint: If user(s) need access to multiple contracts, give access to all the contracts at the same time. - Access must be granted in correct module! Slide 170: Access Assignment - Screenshot: Focal Point Main Menu - Screenshot: Access Authorization Menu Slide 171: Access Assignment - Screenshot: Create New User Access Slide 172: Access Assignment - Screenshot: User Access Authorization Matrix -What not to do: -Anything After Name -Last Name First -Create User ID -Company -Rank or Title -What to do: -First and Last -Use Middle Initial, if Necessary -Enter an individual Slide 173: Modifying Access - Access Authorization - Modify Existing User Access - Modify by Contract - List of All Users with Access to Specific Contract - Change User’s Role for Specific Contract - Remove User From Contract - Delete User - Modify by User - List of All User’s Contracts - Change User’s Role on Contract(s) - Remove User From Contract(s) - Delete User - Remove Access - Can No Longer Access Specific Contract; User Account Still Exists - Delete User - Can No Longer Access Any Contracts; User Account No Longer Exists Slide 174: Modifying Access - Screenshot: Focal Point Main Menu - Screenshot: Access Authorization Menu Slide 175: Modifying Access - Screenshot Modify Existing User Access - Screenshot: Remove Access Slide 176: Modifying Access - Screenshot: Modify Existing User Access - Screenshot: Reset Password Slide 177: Modifying Access - Screenshot: Modify Existing User Access - Screenshot: Modify Access Slide 178: Modifying Access - Screenshot: Modify Existing User Access - Screenshot: Change Profile Slide 179: Modifying Access - Screenshot: Modify Existing User Access - Screenshot: Delete User Slide 180: Account Maintenance - Access Authorization - Modify Existing User Access - Modify by User - Change User Profile - Name, Organization, Title - Email Address - Phone Numbers - Update User’s Signature Block - Reset Password (Non-PKI) - New Temporary Password - Helpful Hint: Forgot Password Button is Preferred Way of Resetting Passwords Slide 181: Access Transfers - Access Authorization - Transfer User Access to Another User - Transfer From User - Retain Account Following Transfer - Delete Account Following Transfer - Transfer Contracts - Specify Contract(s) - All Contracts - Transfer To - New User - Existing User - Retain Account - User will still access CPARS, but will use different contracts. - Delete Account - User will no longer access CPARS. - Helpful Hint: Access Transfers are a quick way to reassign a large number of contracts when a user changes jobs or retires. Slide 182: Access Transfers - Screenshot: Focal Point Main Menu - Screenshot: Access Authorization Menu Slide 183: Access Transfers - Screenshot: Transfer User Access to Another User - Delete user if they no longer need CPARS access. Slide 184: Alternate Focal Points - Access Authorization - Assign Alternate Focal Point - Only Focal Point May Assign Alternates (i.e., Alternate Cannot Have Alternates) - Assign Up To Five Alternates - Enter User Name - New User - Existing User - Alternate Focal Point - Assign - Delete - Reset Password (Non-PKI) - Helpful Hint: If you have a lot of users and contracts to manage, you can have a full time alternate(s). Slide 185: Alternate Focal Points - Screenshot: Focal Point Main Menu - Screenshot: Access Authorization Menu Slide 186: Alternate Focal Points - Screenshot: Assign Alternate Focal Point(s) Slide 187: Additional Information - Help Desk (Mon-Fri 6:30am-6:00pm EST) - Commercial: 207-438-1690 - Email: webptsmh@navy.mil - CPARS Web Site: (www.cpars.gov) - Click on CPARS Link - FAQ - Policy Guidance - Quality Checklist - User Manual - Training Information 1