Posts

Tip of Iceberg

Image
  PC:https://www.dremio.com/resources/guides/apache-iceberg-an-architectural-look-under-the-covers/   In 1912, Titanic ship sank after hitting the iceberg.. While the Titanic might come to mind when we hear 'iceberg,' this post explores a different kind of Iceberg—one revolutionizing data architecture – Apache iceberg. If you know about Apache iceberg , do not waste a minute to read further. There is lot of momentum about Apache iceberg in recent past and you might have heard recent news like Datazip raised $1M fund, Google announced preview of BigQuery tables for Apache Iceberg , Cloudera unveiled a partnership with Snowflake to enhance hybrid data management (introduces a unified hybrid data lakehouse powered by Apache Iceberg).   So, what exactly is Apache Iceberg, and how does it fit into modern data architecture?  Data lakes are ideal for storing massive data in semi structured, unstructured data in native formats.  This is called file-based dat...
Post a Comment
Read more

Informatica Scenario and SQL Scenario Question

Image
Scenario: Source data looks like below   Target 1 (Event number of occurrences) A has come 2 times in the source, it should go to Target 1 Target 2 (odd number of occurrences) If source data repeats odd number of times then it should go to Target 2 Solution: create table test_odd_even_src ( col1 varchar2 ( 3 ) ); create table test_odd_tgt ( col1 varchar2 ( 3 ), col2 int ); create table test_even_tgt ( col1 varchar2 ( 3 ), col2 int ) ; insert into test_odd_even_src values( 'A' ); insert into test_odd_even_src values( 'A' ); insert into test_odd_even_src values( 'B' ); insert into test_odd_even_src values( 'B' ); insert into test_odd_even_src values( 'B' ); insert into test_odd_even_src values( 'C' ); insert into test_odd_even_src values( 'D' ); Mapping Looks like this: Aggregator Transformation: ...
19 comments
Read more

SQL Test : Sample Questions from Amazon Test (2/2)

  SQL questions are about monorail company. Database consists of tables for a monorail company.   Below listed table definition with column name and one row of sample data. 1.       Table employee contains information of all the employee in the organization (including drivers of monorail).   | eid   | ename    | salary | | 555   | Raheem   | 235     |   2. Table monorail Contains the information aboubt each monorail.   | rid     | rname        | running_range | | 1234   | Speedster   | 454             |   3. Table route_info contains the description of route on which monorails used to travel.     | route_no     | origin        | distance | cost | | 4456        | Gwalior      | Delhi     | 543   |   4. Table assignment contains the data about which monorail is driven by which employee. This can be a many-to-many relation.   | eid     | rid        | | 101  ...
31 comments
Read more