Establishing a Testing Centre of Excellence for a Leading Bank
Executive Summary
A leading bank aimed to modernize its software testing processes by establishing a Testing Center of Excellence (TCoE). The initiative focused on implementing a standardized test methodology, setting up a state-of-the-art test lab, and streamlining manual, automation, and performance testing processes. This case study details the challenges, solutions, and results of the initiative, which resulted in improved software quality, reduced time-to-market, and significant cost savings.
Background
Client
A top-tier national bank with a diverse portfolio of financial services.
Industry
Banking and Financial Services.
Project Objective
Centralize and standardize testing practices across the bank's software development projects.
Enhance test efficiency, quality, and scalability to support the bank's digital transformation.
Key Stakeholders
IT department, QA managers, business analysts, and software development teams.
Challenges
Fragmented Testing Processes
Testing was inconsistent across projects, leading to duplicated efforts and gaps in quality. Testing mostly done by development vendor only UAT done in Bank
Delinked Testing Process
Testing process not linked to PMO, Development process
Vendor Drive Development Model
Vendor proposed model Waterfall, Agile, Hybrid followed with no explicit test process of each model
No Testing Tools and Test Labs
Used Excel and word documents
Resource Constraints
Lack of a centralized test lab and standardized tools hindered efficiency.
Scalability Issues
Existing processes struggled to handle increased testing demands for new digital initiatives.
Solution Approach
Testing Methodology
Standardized Process: Introduced a uniform test methodology based on ISTQB and Agile principles.
Test Lifecycle Management: Defined phases for test planning, execution, defect management, and reporting.
Training Programs: Upskilled team members in advanced testing practices and tools.
Automation Testing
Framework Design: Implemented a hybrid test automation framework to support multiple banking applications.
Tool Selection: Select tools to automation Web, mobile, desktop apps and other legacy systems.
Regression Testing: Automated key workflows to reduce the time spent on repetitive tasks.
Test Lab Setup
Infrastructure: Provided architecture, established centralized, virtualized test lab for testing tool-Production and test.
Tools Integration: Deployed leading tools for test management, automation, performance testing and defect management.
Performance Testing
Baseline Metrics: Defined benchmarks for application performance under various loads.
Scalability Testing: Simulated peak transaction loads to identify bottlenecks.
Continuous Monitoring: Integrated performance testing into CI/CD pipelines.
Manual Testing
Test Case Standardization: Developed comprehensive test cases for critical banking applications.
Domain Expertise: Leveraged banking domain knowledge to ensure high-quality test coverage.
Execution
Planning
Conducted workshops with stakeholders to define TCoE objectives and KPIs.
Implementation
Set up the test lab and integrated tools, including the CI/CD integrations
Executed 2 pilot projects to validate the new methodology.
Complete 4 full projects using the new methodology
Scaling
Gradually onboarded all projects into the TCoE framework.
Monitoring and Feedback
Regularly assessed performance against KPIs, adjusting strategies as needed.
Quantitative Results
40% Reduction in testing cycle times due to automation.
30% Cost Savings by centralizing resources and reducing defects in production
Increased Coverage: Achieved 95% test coverage for critical applications
Qualitative Results
Improved collaboration between QA and development teams.
Enhanced customer satisfaction due to fewer post-release defects.
Greater confidence in application stability during high-demand periods.
Key Learnings and Best Practices
Start Small
Piloting with a smaller project helped refine the TCoE approach.
Invest in Training
Continuous upskilling of team members ensured smooth adoption of new tools and practices.
Monitor Continuously
Regular feedback loops were crucial for sustaining TCoE effectiveness.
The establishment of the TCoE transformed the bank’s testing processes, enabling them to meet the demands of modern banking systems effectively. This initiative not only enhanced operational efficiency but also fortified the bank’s commitment to delivering exceptional customer experiences.
Malaysia
Manthra Software Services Sdn Bhd Unit 20-01, The Vertical A, Avenue 3, Bangsar South, No 8, Jalan Kerinchi, Kuala Lumpur 59200