trying to join two streams using inner join and storing the resultant data into a topic but one of the column is missing in topic schema

0 votes
Source Streams:

CREATE STREAM one ( ADC_ID BIGINT, ETL_DATATYPE VARCHAR(400)) WITH(KAFKA_TOPIC ='AMM_DATATYPE_CONVERSION',PARTITIONS=1,REPLICAS=1, VALUE_FORMAT='AVRO');

CREATE STREAM two ( ADT_ID BIGINT KEY,DATATYPE VARCHAR(400)) WITH(KAFKA_TOPIC ='AMM_DATATYPES',PARTITIONS=1,REPLICAS=1, VALUE_FORMAT='AVRO');

Target Stream:

CREATE STREAM TargetStream WITH (KAFKA_TOPIC ='TestTopic', VALUE_FORMAT='AVRO', PARTITIONS=3 )
AS SELECT CONCAT_WS('',one.ETL_DATATYPE,two.DATATYPE) AS ADDRESS,
one.ADC_ID as ADCID, one.ETL_DATATYPE as ETLDATATYPE, two.ADT_ID as ADTID
from one inner join two WITHIN 1 DAY on one.ADC_ID=two.ADT_ID EMIT CHANGES LIMIT 3;

here in this example ADCID column is missing in TestTopic.
May 1, 2021 in Apache Kafka by anonymous

edited 6 hours ago 57 views

No answer to this question. Be the first to respond.

Your answer

Your name to display (optional):
Privacy: Your email address will only be used for sending these notifications.
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP