<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
xmlns:content="http://purl.org/rss/1.0/modules/content/"
xmlns:wfw="http://wellformedweb.org/CommentAPI/"
xmlns:dc="http://purl.org/dc/elements/1.1/"
xmlns:atom="http://www.w3.org/2005/Atom"
xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
>
<channel>
<title>Uncategorized Archives - Datagaps | Gen AI-Powered Automated Cloud Data Testing</title>
<atom:link href="https://www.datagaps.com/blog/category/uncategorized/feed/" rel="self" type="application/rss+xml" />
<link>https://www.datagaps.com/blog/category/uncategorized/</link>
<description></description>
<lastBuildDate>Wed, 03 Jan 2024 10:40:24 +0000</lastBuildDate>
<language>en-US</language>
<sy:updatePeriod>
hourly </sy:updatePeriod>
<sy:updateFrequency>
1 </sy:updateFrequency>
<generator>https://wordpress.org/?v=6.9.4</generator>
<image>
<url>https://www.datagaps.com/wp-content/uploads/Datagaps-India-Favicon-Lite-theme-150x150.jpg</url>
<title>Uncategorized Archives - Datagaps | Gen AI-Powered Automated Cloud Data Testing</title>
<link>https://www.datagaps.com/blog/category/uncategorized/</link>
<width>32</width>
<height>32</height>
</image>
<item>
<title>DataOps Suite: Validate Rest API Response</title>
<link>https://www.datagaps.com/blog/validate-rest-api-response/</link>
<dc:creator><![CDATA[Rajesh Kumar]]></dc:creator>
<pubDate>Wed, 11 Mar 2020 13:34:52 +0000</pubDate>
<category><![CDATA[Uncategorized]]></category>
<guid isPermaLink="false">https://staging9.datagaps.com/?p=7056</guid>
<description><![CDATA[<p>DataFlow is a powerful application using which you can easily perform end-to-end automation of a data migration process. In DataFlow, there are different kinds of components to serve different purposes. One of them is the Code Component. It supports three kinds of languages.</p>
<p>The post <a href="https://www.datagaps.com/blog/validate-rest-api-response/">DataOps Suite: Validate Rest API Response</a> appeared first on <a href="https://www.datagaps.com">Datagaps | Gen AI-Powered Automated Cloud Data Testing</a>.</p>
]]></description>
<content:encoded><![CDATA[ <div data-elementor-type="wp-post" data-elementor-id="7056" class="elementor elementor-7056" data-elementor-post-type="post">
<section class="elementor-section elementor-top-section elementor-element elementor-element-b9704b0 elementor-section-boxed elementor-section-height-default elementor-section-height-default" data-id="b9704b0" data-element_type="section" data-e-type="section">
<div class="elementor-container elementor-column-gap-default">
<div class="elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-3a576fc" data-id="3a576fc" data-element_type="column" data-e-type="column">
<div class="elementor-widget-wrap elementor-element-populated">
<div class="elementor-element elementor-element-2f0676c elementor-widget elementor-widget-image" data-id="2f0676c" data-element_type="widget" data-e-type="widget" data-widget_type="image.default">
<div class="elementor-widget-container">
<img decoding="async" width="640" height="76" src="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-6-1-1024x122.webp" class="attachment-large size-large wp-image-7058" alt="DataOps-Suite_-Validation-of-Rest-API-data-6-1" srcset="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-6-1-1024x122.webp 1024w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-6-1-300x36.webp 300w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-6-1-768x91.webp 768w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-6-1.webp 1310w" sizes="(max-width: 640px) 100vw, 640px" /> </div>
</div>
<div class="elementor-element elementor-element-220487e elementor-widget elementor-widget-text-editor" data-id="220487e" data-element_type="widget" data-e-type="widget" data-widget_type="text-editor.default">
<div class="elementor-widget-container">
<p>DataOps Suite supports data validation for different kinds of Data sources. Along with other Data sources also it has support for Rest API.</p><p><a href="https://www.datagaps.com/dataops-suite/dataflow/">DataFlow</a> is a powerful application using which you can easily perform end-to-end automation of a data migration process. In DataFlow, there are different kinds of components to serve different purposes. One of them is the Code Component. It supports three kinds of languages. Spark SQL, Scala, Python. Using the Code Component, you can write queries or code on top of different datasets created in the current DataFlow. This gives you flexibility to do different DML operations on top of the existing datasets. This document covers reading the data from a Rest API, converting into a dataset and comparing it with another dataset from file.</p><p>Please go through the following steps:</p><ol><li>On the left menu, select ‘DataFlows’.</li><li>Click on ‘New DataFlow’ button on the top right corner.</li></ol> </div>
</div>
<div class="elementor-element elementor-element-2811d71 elementor-widget elementor-widget-image" data-id="2811d71" data-element_type="widget" data-e-type="widget" data-widget_type="image.default">
<div class="elementor-widget-container">
<img fetchpriority="high" decoding="async" width="640" height="243" src="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-1-1024x388.webp" class="attachment-large size-large wp-image-3809" alt="DataOps-Suite_-Validation-of-Rest-API-data-1" srcset="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-1-1024x388.webp 1024w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-1-300x114.webp 300w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-1-768x291.webp 768w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-1-1536x582.webp 1536w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-1.webp 1600w" sizes="(max-width: 640px) 100vw, 640px" /> </div>
</div>
<div class="elementor-element elementor-element-fac99d4 elementor-widget elementor-widget-text-editor" data-id="fac99d4" data-element_type="widget" data-e-type="widget" data-widget_type="text-editor.default">
<div class="elementor-widget-container">
<ol><li>In the ‘New DataFlow’ dialog, fill the details and Save.<ol><li type="a"><strong>Name:</strong> Any random name to identify DataFlow.</li><li type="a"><strong>Livy server:</strong> By default, the application comes with a default livy server. Select any configured livy server.</li></ol></li></ol> </div>
</div>
<div class="elementor-element elementor-element-fa25095 elementor-widget elementor-widget-image" data-id="fa25095" data-element_type="widget" data-e-type="widget" data-widget_type="image.default">
<div class="elementor-widget-container">
<img decoding="async" width="640" height="426" src="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-2-1.webp" class="attachment-large size-large wp-image-7065" alt="DataOps-Suite_-Validation-of-Rest-API-data-2-1" srcset="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-2-1.webp 751w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-2-1-300x200.webp 300w" sizes="(max-width: 640px) 100vw, 640px" /> </div>
</div>
<div class="elementor-element elementor-element-418626d elementor-widget elementor-widget-text-editor" data-id="418626d" data-element_type="widget" data-e-type="widget" data-widget_type="text-editor.default">
<div class="elementor-widget-container">
<ol>
<li>During the first run, all the list of components are displayed (as shown in the below image). Select Code component in the processor bucket.</li>
</ol> </div>
</div>
<div class="elementor-element elementor-element-2b59435 elementor-widget elementor-widget-image" data-id="2b59435" data-element_type="widget" data-e-type="widget" data-widget_type="image.default">
<div class="elementor-widget-container">
<img loading="lazy" decoding="async" width="640" height="229" src="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-3-1-1024x366.webp" class="attachment-large size-large wp-image-7066" alt="DataOps-Suite_-Validation-of-Rest-API-data-3" srcset="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-3-1-1024x366.webp 1024w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-3-1-300x107.webp 300w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-3-1-768x275.webp 768w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-3-1-1536x549.webp 1536w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-3-1.webp 1600w" sizes="(max-width: 640px) 100vw, 640px" /> </div>
</div>
<div class="elementor-element elementor-element-bca5ec6 elementor-widget elementor-widget-text-editor" data-id="bca5ec6" data-element_type="widget" data-e-type="widget" data-widget_type="text-editor.default">
<div class="elementor-widget-container">
<ol>
<li>A new Code component will be opened with the ‘Properties’ tab selected. Fill the details and then go to the next step –
<ol>
<li type="a"><strong>Name:</strong> Any random name.</li>
<li type="a"><strong>Dependency:</strong> Not required as it is the first component.</li>
<li type="a"><strong>Description:</strong> Optional. You can give any useful info about the code component.</li>
<li type="a"><strong>Dataset name:</strong> Name of the dataset which you want to create using the code. You can give multiple names, separated by commas.</li>
</ol>
</li>
</ol> </div>
</div>
<div class="elementor-element elementor-element-30e5a66 elementor-widget elementor-widget-image" data-id="30e5a66" data-element_type="widget" data-e-type="widget" data-widget_type="image.default">
<div class="elementor-widget-container">
<img loading="lazy" decoding="async" width="640" height="76" src="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-6-1-2-1024x122.webp" class="attachment-large size-large wp-image-7067" alt="DataOps-Suite_-Validation-of-Rest-API-data-6-1-2" srcset="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-6-1-2-1024x122.webp 1024w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-6-1-2-300x36.webp 300w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-6-1-2-768x91.webp 768w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-6-1-2.webp 1310w" sizes="(max-width: 640px) 100vw, 640px" /> </div>
</div>
<div class="elementor-element elementor-element-9da4bab elementor-widget elementor-widget-text-editor" data-id="9da4bab" data-element_type="widget" data-e-type="widget" data-widget_type="text-editor.default">
<div class="elementor-widget-container">
<ol>
<li>Select the kind. Scala is selected by default. The Code component supports Scala, Python and SparkR languages. By clicking on the ‘Sample API code’ button on the top right, a sample code will be populated to read data from Rest API. Here a sample code is provided.</li>
</ol> </div>
</div>
<div class="elementor-element elementor-element-875c7d1 elementor-widget elementor-widget-image" data-id="875c7d1" data-element_type="widget" data-e-type="widget" data-widget_type="image.default">
<div class="elementor-widget-container">
<img loading="lazy" decoding="async" width="640" height="251" src="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-5-1-1024x402.webp" class="attachment-large size-large wp-image-7068" alt="DataOps-Suite_-Validation-of-Rest-API-data-5-1" srcset="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-5-1-1024x402.webp 1024w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-5-1-300x118.webp 300w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-5-1-768x301.webp 768w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-5-1.webp 1480w" sizes="(max-width: 640px) 100vw, 640px" /> </div>
</div>
<div class="elementor-element elementor-element-b6e9dcb elementor-widget elementor-widget-text-editor" data-id="b6e9dcb" data-element_type="widget" data-e-type="widget" data-widget_type="text-editor.default">
<div class="elementor-widget-container">
<p><strong>Code:</strong></p>
<p><code>import spark.implicits._;</code></p>
<p><code>var jsonStr =scala.io.Source.fromURL("http://192.168.6.42:9080/DataPrepRest/api/v1.0/templates/table?containerId=81&userName=sh&password=******&url=jdbc:oracle:thin:@192.168.6.76:1521:orcl&schema=sh&table=customers").mkString;</code></p>
<p><code>var df = spark.read.json(Seq(jsonStr).toDS());</code></p>
<p><code>df.createOrReplaceTempView("code_ds");</code></p>
<p><code> </code></p>
<p><code></code><code></code><code></code><code>df.cache();</code><br />After execution of the above code a dataset with the name code_ds will be created. You can write multiple sets of such codes and can create multiple datasets. These datasets should be listed in the Properties tab as mentioned in the 5th step.</p>
<ol>
<li>Create a new File component. Fill the details and move to the next step –</li>
</ol> </div>
</div>
<div class="elementor-element elementor-element-0e1237f elementor-widget elementor-widget-image" data-id="0e1237f" data-element_type="widget" data-e-type="widget" data-widget_type="image.default">
<div class="elementor-widget-container">
<img loading="lazy" decoding="async" width="640" height="76" src="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-6-1-3-1024x122.webp" class="attachment-large size-large wp-image-7071" alt="Add component" srcset="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-6-1-3-1024x122.webp 1024w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-6-1-3-300x36.webp 300w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-6-1-3-768x91.webp 768w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-6-1-3.webp 1310w" sizes="(max-width: 640px) 100vw, 640px" /> </div>
</div>
<div class="elementor-element elementor-element-a12a40b elementor-widget elementor-widget-text-editor" data-id="a12a40b" data-element_type="widget" data-e-type="widget" data-widget_type="text-editor.default">
<div class="elementor-widget-container">
<ol>
<li type="a"><strong>Name:</strong> Any random name.</li>
<li type="a"><strong>Data Source:</strong> File data source list can be seen here. You need to select a data source.</li>
<li type="a"><strong>Dependency: </strong>In the present case, there’s no need to give any dependency.</li>
<li type="a"><strong>Description: </strong>Optional. Write some basic info about the component.</li>
<li type="a"><strong>Dataset name:</strong> For File components, only one dataset will be created. Default name will be populated based on the component name. You can enter your desired Dataset name.</li>
</ol> </div>
</div>
<div class="elementor-element elementor-element-c111e49 elementor-widget elementor-widget-image" data-id="c111e49" data-element_type="widget" data-e-type="widget" data-widget_type="image.default">
<div class="elementor-widget-container">
<img loading="lazy" decoding="async" width="640" height="249" src="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-8-1-1024x399.webp" class="attachment-large size-large wp-image-7072" alt="DataOps-Suite_-Validation-of-Rest-API-data-8-1" srcset="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-8-1-1024x399.webp 1024w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-8-1-300x117.webp 300w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-8-1-768x299.webp 768w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-8-1.webp 1481w" sizes="(max-width: 640px) 100vw, 640px" /> </div>
</div>
<div class="elementor-element elementor-element-a3912e7 elementor-widget elementor-widget-text-editor" data-id="a3912e7" data-element_type="widget" data-e-type="widget" data-widget_type="text-editor.default">
<div class="elementor-widget-container">
<ol>
<li>In the File step, fill in the details as shown below –
<ol>
<li type="a"><strong>File Name:</strong> Give the filename you want to read. Enter the filename manually or select a filename in the Files panel on the right.</li>
<li type="a"><strong>Encode:</strong> Optional (File encoding type).</li>
<li type="a"><strong>Options:</strong> Spark file read options. Some important options will be popped up with the default values. Please go through the following link for further info –
<a href="https://docs.databricks.com/external-data/csv.html" target="_blank" rel="noopener noreferrer">https://docs.databricks.com/data/data-sources/read-csv.html</a>.</li>
</ol>
</li>
</ol> </div>
</div>
<div class="elementor-element elementor-element-4928992 elementor-widget elementor-widget-image" data-id="4928992" data-element_type="widget" data-e-type="widget" data-widget_type="image.default">
<div class="elementor-widget-container">
<img loading="lazy" decoding="async" width="640" height="253" src="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-9-1-1024x405.webp" class="attachment-large size-large wp-image-7073" alt="DataOps-Suite_-Validation-of-Rest-API-data-9-1" srcset="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-9-1-1024x405.webp 1024w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-9-1-300x119.webp 300w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-9-1-768x303.webp 768w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-9-1.webp 1488w" sizes="(max-width: 640px) 100vw, 640px" /> </div>
</div>
<div class="elementor-element elementor-element-c0cb8f6 elementor-widget elementor-widget-text-editor" data-id="c0cb8f6" data-element_type="widget" data-e-type="widget" data-widget_type="text-editor.default">
<div class="elementor-widget-container">
<ol>
<li><strong>code_ds</strong> is the dataset created by reading Rest API data in the Code component. By default, all the data types will be considered as string. If you want to change these data types or column names, you can use the Attribute component. For any dataset, you can change the data types by using the Attribute component. Create a new Attribute component by using Add component.</li>
</ol> </div>
</div>
<div class="elementor-element elementor-element-f6d2f9c elementor-widget elementor-widget-image" data-id="f6d2f9c" data-element_type="widget" data-e-type="widget" data-widget_type="image.default">
<div class="elementor-widget-container">
<img loading="lazy" decoding="async" width="640" height="76" src="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-10-1-1024x122.webp" class="attachment-large size-large wp-image-7074" alt="DataOps-Suite_-Validation-of-Rest-API-data-10-1" srcset="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-10-1-1024x122.webp 1024w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-10-1-300x36.webp 300w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-10-1-768x91.webp 768w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-10-1.webp 1310w" sizes="(max-width: 640px) 100vw, 640px" /> </div>
</div>
<div class="elementor-element elementor-element-e999bc5 elementor-widget elementor-widget-text-editor" data-id="e999bc5" data-element_type="widget" data-e-type="widget" data-widget_type="text-editor.default">
<div class="elementor-widget-container">
<p>Fill the details –</p><ol>
<li type="a"><strong>Name:</strong> Any random name</li>
<li type="a"><strong>Source Dataset:</strong> For which dataset user wants to change data types and column names. In the current example, we are selecting code_ds which is the output of the Code component.</li>
<li type="a"><strong>Dependency:</strong> As this component can be run only after creation of code_ds dataset from the Code component, you must add the code component in the dependency list.</li>
<li type="a"><strong>Description:</strong> Optional (description of the component).</li>
<li type="a"><strong>Dataset Name:</strong> Output dataset name. After converting data types and column names, a new dataset will be created as the output. Default is the component name.</li>
</ol> </div>
</div>
<div class="elementor-element elementor-element-ae30c83 elementor-widget elementor-widget-image" data-id="ae30c83" data-element_type="widget" data-e-type="widget" data-widget_type="image.default">
<div class="elementor-widget-container">
<img loading="lazy" decoding="async" width="640" height="252" src="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-11-1-1024x403.webp" class="attachment-large size-large wp-image-7076" alt="DataOps-Suite_-Validation-of-Rest-API-data-11-1" srcset="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-11-1-1024x403.webp 1024w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-11-1-300x118.webp 300w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-11-1-768x302.webp 768w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-11-1.webp 1494w" sizes="(max-width: 640px) 100vw, 640px" /> </div>
</div>
<div class="elementor-element elementor-element-9c2bc3d elementor-widget elementor-widget-text-editor" data-id="9c2bc3d" data-element_type="widget" data-e-type="widget" data-widget_type="text-editor.default">
<div class="elementor-widget-container">
<ol>
<li>In the rename step, enter the desired column names and data types.</li>
</ol> </div>
</div>
<div class="elementor-element elementor-element-514d8c0 elementor-widget elementor-widget-image" data-id="514d8c0" data-element_type="widget" data-e-type="widget" data-widget_type="image.default">
<div class="elementor-widget-container">
<img loading="lazy" decoding="async" width="640" height="253" src="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-12-1-1024x405.webp" class="attachment-large size-large wp-image-7077" alt="DataOps-Suite_-Validation-of-Rest-API-data-12-1" srcset="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-12-1-1024x405.webp 1024w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-12-1-300x119.webp 300w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-12-1-768x304.webp 768w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-12-1.webp 1490w" sizes="(max-width: 640px) 100vw, 640px" /> </div>
</div>
<div class="elementor-element elementor-element-a83ed82 elementor-widget elementor-widget-text-editor" data-id="a83ed82" data-element_type="widget" data-e-type="widget" data-widget_type="text-editor.default">
<div class="elementor-widget-container">
<ol>
<li>Save and Run the component.</li>
<li>Now click on Add component and select ‘Data Compare’ from the ‘Data Quality bucket’ as shown below –</li>
</ol> </div>
</div>
<div class="elementor-element elementor-element-58064d9 elementor-widget elementor-widget-image" data-id="58064d9" data-element_type="widget" data-e-type="widget" data-widget_type="image.default">
<div class="elementor-widget-container">
<img loading="lazy" decoding="async" width="640" height="231" src="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-13-1-1024x370.webp" class="attachment-large size-large wp-image-7078" alt="DataOps-Suite_-Validation-of-Rest-API-data-13-1" srcset="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-13-1-1024x370.webp 1024w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-13-1-300x108.webp 300w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-13-1-768x277.webp 768w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-13-1-1536x555.webp 1536w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-13-1.webp 1600w" sizes="(max-width: 640px) 100vw, 640px" /> </div>
</div>
<div class="elementor-element elementor-element-eab1294 elementor-widget elementor-widget-text-editor" data-id="eab1294" data-element_type="widget" data-e-type="widget" data-widget_type="text-editor.default">
<div class="elementor-widget-container">
<ol>
<li>In the ‘Data Compare’ component, you need to give two datasets as input. The comparison would be between these two datasets. Fill the details –
<ol>
<li type="a"><strong>Name:</strong> Any Random name.</li>
<li type="a"><strong>Dataset A:</strong> In this example we are selecting the output of Attribute component.</li>
<li type="a"><strong>Dataset B:</strong> In this example we are selecting output of File component.</li>
<li type="a"><strong>Dependency:</strong> In this example we are consuming datasets from file component and attribute component. So give both of them as dependencies.</li>
<li type="a"><strong>Compare type:</strong> Different comparison types you want to run.</li>
<li type="a"><strong>Description:</strong> Description of the component.</li>
<li type="a"><strong>Dataset Name:</strong> Default name will be populated.</li>
</ol>
</li>
</ol> </div>
</div>
<div class="elementor-element elementor-element-8204316 elementor-widget elementor-widget-image" data-id="8204316" data-element_type="widget" data-e-type="widget" data-widget_type="image.default">
<div class="elementor-widget-container">
<img loading="lazy" decoding="async" width="640" height="229" src="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-14-1-1024x367.webp" class="attachment-large size-large wp-image-7079" alt="DataOps-Suite_-Validation-of-Rest-API-data-14-1" srcset="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-14-1-1024x367.webp 1024w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-14-1-300x108.webp 300w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-14-1-768x276.webp 768w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-14-1-1536x551.webp 1536w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-14-1.webp 1600w" sizes="(max-width: 640px) 100vw, 640px" /> </div>
</div>
<div class="elementor-element elementor-element-417283f elementor-widget elementor-widget-text-editor" data-id="417283f" data-element_type="widget" data-e-type="widget" data-widget_type="text-editor.default">
<div class="elementor-widget-container">
<ol>
<li>In the mapping step both dataset A and dataset B will be mapped by order of columns by default. If required, you can click on the “Remap by Name” button to reorder the mapping. You can select unique keys, then comparison would be based on keys. It allows multiple key columns. Move to next step after changes done.</li>
</ol> </div>
</div>
<div class="elementor-element elementor-element-fb70b34 elementor-widget elementor-widget-image" data-id="fb70b34" data-element_type="widget" data-e-type="widget" data-widget_type="image.default">
<div class="elementor-widget-container">
<img loading="lazy" decoding="async" width="640" height="231" src="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-15-1-1024x370.webp" class="attachment-large size-large wp-image-7080" alt="DataOps-Suite_-Validation-of-Rest-API-data-15-1" srcset="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-15-1-1024x370.webp 1024w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-15-1-300x108.webp 300w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-15-1-768x277.webp 768w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-15-1-1536x555.webp 1536w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-15-1.webp 1600w" sizes="(max-width: 640px) 100vw, 640px" /> </div>
</div>
<div class="elementor-element elementor-element-2f6fe94 elementor-widget elementor-widget-text-editor" data-id="2f6fe94" data-element_type="widget" data-e-type="widget" data-widget_type="text-editor.default">
<div class="elementor-widget-container">
<ol>
<li>Run the component. Each component executes in a set of statements. Data Comparison component contains more number of statements and the progress of execution can be seen at the bottom in the ‘Run’ tab. After the Run is completed, you can see the component results as shown in the following images. At the bottom, you can see failed and passed statements. These statements contain Duplicate calculation, Only in Dataset A, Only in Dataset B, Differences etc. For each calculation a statement will be there. By clicking on the link, you can see the details of each statement.</li>
</ol> </div>
</div>
<div class="elementor-element elementor-element-4c46847 elementor-widget elementor-widget-image" data-id="4c46847" data-element_type="widget" data-e-type="widget" data-widget_type="image.default">
<div class="elementor-widget-container">
<img loading="lazy" decoding="async" width="640" height="234" src="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-16-1-1024x374.webp" class="attachment-large size-large wp-image-7083" alt="DataOps-Suite_-Validation-of-Rest-API-data-16-1" srcset="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-16-1-1024x374.webp 1024w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-16-1-300x110.webp 300w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-16-1-768x280.webp 768w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-16-1-1536x561.webp 1536w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-16-1.webp 1600w" sizes="(max-width: 640px) 100vw, 640px" /> </div>
</div>
<div class="elementor-element elementor-element-1fa2926 elementor-widget elementor-widget-text-editor" data-id="1fa2926" data-element_type="widget" data-e-type="widget" data-widget_type="text-editor.default">
<div class="elementor-widget-container">
<ol>
<li>By clicking on the difference count statement, a window pops up. Please check the following image.</li>
</ol> </div>
</div>
<div class="elementor-element elementor-element-56e7849 elementor-widget elementor-widget-image" data-id="56e7849" data-element_type="widget" data-e-type="widget" data-widget_type="image.default">
<div class="elementor-widget-container">
<img loading="lazy" decoding="async" width="640" height="251" src="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-17-1-1024x402.webp" class="attachment-large size-large wp-image-7084" alt="DataOps-Suite_-Validation-of-Rest-API-data-17-1" srcset="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-17-1-1024x402.webp 1024w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-17-1-300x118.webp 300w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-17-1-768x301.webp 768w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-17-1-1536x603.webp 1536w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-17-1.webp 1600w" sizes="(max-width: 640px) 100vw, 640px" /> </div>
</div>
<div class="elementor-element elementor-element-ea4c51b elementor-widget elementor-widget-text-editor" data-id="ea4c51b" data-element_type="widget" data-e-type="widget" data-widget_type="text-editor.default">
<div class="elementor-widget-container">
<ol><li>Now the design of DataFlow has been completed. It’s a one time step. You can run the DataFlow whenever you want just by clicking the “Run DataFlow” button at the top of the DataFlow window. Then the following window opens –</li></ol> </div>
</div>
<div class="elementor-element elementor-element-624add4 elementor-widget elementor-widget-image" data-id="624add4" data-element_type="widget" data-e-type="widget" data-widget_type="image.default">
<div class="elementor-widget-container">
<img loading="lazy" decoding="async" width="640" height="256" src="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-18-1-1024x410.webp" class="attachment-large size-large wp-image-7085" alt="DataOps-Suite_-Validation-of-Rest-API-data-18-1" srcset="https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-18-1-1024x410.webp 1024w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-18-1-300x120.webp 300w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-18-1-768x307.webp 768w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-18-1-1536x614.webp 1536w, https://www.datagaps.com/wp-content/uploads/DataOps-Suite_-Validation-of-Rest-API-data-18-1.webp 1600w" sizes="(max-width: 640px) 100vw, 640px" /> </div>
</div>
<div class="elementor-element elementor-element-034e324 elementor-widget elementor-widget-text-editor" data-id="034e324" data-element_type="widget" data-e-type="widget" data-widget_type="text-editor.default">
<div class="elementor-widget-container">
<p>This image is created based on the dependencies given. And it is the execution order of components. Here each color indicates the progress of different components –</p>
<ul>
<li><strong>Green:</strong> Successfully completed and the status is passed.</li>
<li><strong>Blue:</strong> In Queue.</li>
<li><strong>Yellow:</strong> Running</li>
<li><strong>Red: </strong>Completed. But the status is failure.</li>
</ul> </div>
</div>
<div class="elementor-element elementor-element-b7835b6 elementor-widget-divider--view-line elementor-widget elementor-widget-divider" data-id="b7835b6" data-element_type="widget" data-e-type="widget" data-widget_type="divider.default">
<div class="elementor-widget-container">
<div class="elementor-divider">
<span class="elementor-divider-separator">
</span>
</div>
</div>
</div>
</div>
</div>
</div>
</section>
</div>
<p>The post <a href="https://www.datagaps.com/blog/validate-rest-api-response/">DataOps Suite: Validate Rest API Response</a> appeared first on <a href="https://www.datagaps.com">Datagaps | Gen AI-Powered Automated Cloud Data Testing</a>.</p>
]]></content:encoded>
</item>
</channel>
</rss>