Generally we follow:1. Unit testing2. Integration testing3. End to end testingIn Unit testing what we do is we will check the source and target counts for each and every mapping. This document you can prepare in a xl where in you have a columns like source query and target query.In Integration testing what we do is we will check the functionality of that particular mapping. The other test we do is an end to end test wherein you enter the data in source and check that for delta and full loads multiple times.These things you can prepare in a xl or in a word doc by the columns which I have mentioned earlier. As per my knowledge from Informatica Test case:1.
![]() ![]()
ETL estimation template. Hi Folks, Can anyone please post a sample estimation effort template(ETL). If neededData volumes for unit testing. Where from can I get Datawarehouse Tool Kit and Datawarehouse ETL tool kit? Sorry if this sounds to be dumb quetion. Experience with 1 or more mainstream ETL tools (Talend 5.x, DataStage. Ability to device solution and document them as part of design; Continuously learns. Create and execute unit tests on all solutions, work with Data analysts and QA.
WOrkflow/ Mapping is valid or not.2. Are they in proper location.3. Status of target table before running the loading.4. Status of target table after loading.5.
Check if the data which is supposed to load to the target table as per the mapping logic is loaded or not.6. If there is an Update / Delete Logic the expected data got Updated or Deleted or not.- For 3 to 6 generally take help of SQL -7. Check if the process completed successfully without any error or not ( See log Files)These are in General Test cases for ETL. U can add more conditions depending on your ETL logic. Testing of ELT is slightly different then the Generic testin. Here in ETLtesting we need to test the Transformation logic and Business Requirement.For that we need to create the SQL Queries for source leven as well as fortarget.
Then we need to comare the result of the both to verify thecorrectness.asic checkes are:Source and Target record countSource n target data type checkDiff Constraints checkdata check.etc.I hope this will give u a slight idea. For more info keep on posting.
You probably use checklists to record and efficiently execute a wide range of daily work tasks. But if you don’t use checklists for developing and monitoring your data warehouse quality assurance (QA), you’re missing an enormous boost in productivity and proficiency.Procedural data warehouse checklists serve as concrete reminders of which jobs we need to perform and the order in which we need to perform them. They are an informational aid used to reduce failure by compensating for the potential limits of human memory and attention.In this article, I will provide test planners and testers with ideas for data warehouse checklists that help them avoid often-overlooked tasks, including tasks that require special attention during the complexity of data warehouse test planning and test execution efforts. Checklists can help with the development of the overall test strategy, the selection and prioritisation of test cases, and the successful completion of troubleshooting.
Load the database with peak expected production volumes to help ensure that the volume of data can be loaded by the ETL process within the agreed-on window. Compare ETL loading times to loads performed with a smaller amount of data to anticipate scalability issues. Compare the ETL processing times component by component to pinpoint any areas of weakness. Monitor the timing of the reject process, and consider how large volumes of rejected data will be handled. Perform simple and multiple join queries to validate query performance on large database volumes. Work with business users to develop sample queries and acceptable performance criteria for each query. Make sure the functionality of the system meets the business specifications.
Look for the count of records in source tables and compare them with counts in target tables, followed by analysis of rejected records. Check for end-to-end integration of systems and connectivity of the infrastructure—for example, make sure hardware and network configurations are correct. Check all transactions, database updates, and data-flow functions for accuracy. Validate the functionality of the business reports. This website uses cookies to improve your experience while you navigate through the website. Out of these cookies, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website.
These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies.
But opting out of some of these cookies may have an effect on your browsing experience. This website uses cookies to improve your experience while you navigate through the website. Out of these cookies, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may have an effect on your browsing experience.
![]() Comments are closed.
|
AuthorWrite something about yourself. No need to be fancy, just an overview. Archives
March 2023
Categories |