Import Rest API Data into SQL server using Azure Data Factory (ADF)

Fermé Publié le il y a 2 mois Paiement à la livraison
Fermé Paiement à la livraison

Hi There,

I have REST API and I need to import the data into a Azure SQL Server table.

I am using Azure Data Factory Data flow (attached) which was working fine but as the data grew I started getting the below error

Azure data factory REST API Job aborted due to stage failure: Serialized task 16:0 was bytes, which exceeds max allowed: [login to view URL] (134217728 bytes).

So I had to split the source API data into two parts using $top and $skip

Like below, two URL calls.

abc?$expand=xx,yy,zz&$top=40000&$skip=0

abc?$expand=xx,yy,zz&$top=40000&$skip=40000

I am looking for efficient way of doing it by using for loop or parametrization or anything which makes it work even if the data further grows.

Example API data : [login to view URL]$expand=Trips

If you can use above api and import all the data fields into SQL server.

ADF / Oracle ADF Azure Serveur SQL Microsoft JSON

Nº du projet : #37514388

À propos du projet

12 propositions Projet à distance Actif il y a un mois

12 freelances font une offre moyenne de 43 $ pour ce travail

vw7590795vw

I read your requirement for Azure Data Factory. I will check your REST API data and help you to resolve your problem. I have good experience in import data at SQL Server. You can view my profile for completed project Plus

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% AUD en 1 jour
(15 Commentaires)
3.9
akhileshgandhi

Hello, We would like to assist you with your requirements for importing Rest API data into a SQL server using Azure Data Factory (ADF). We have expertise in ADF, Oracle ADF, Azure, and Microsoft SQL Server. I underst Plus

$30 AUD en 7 jours
(7 Commentaires)
3.2
Samaji206

Hello I understand your request that you’re demanding Import Rest API Data into SQL server using Azure Data Factory (ADF) As a Professional Geeks, I can avail creative, proactive and high-tech solutions to your devel Plus

%bids___i_sum_sub_32% %project_currencyDetails_sign_sub_33% AUD en 1 jour
(0 Commentaires)
0.0
durgesh8527

Hello there! My name is Pllavi and I am a full-time web and mobile app developer working as a freelancer. I understand that you need to import data from REST API into Azure SQL server using Azure Data Factory (ADF). Plus

$30 AUD en 7 jours
(0 Commentaires)
0.0
anayapallavi

I can Import Rest API Data into SQL server using Azure Data Factory. Please initiate a message for further discussion.

$50 AUD en 2 jours
(0 Commentaires)
0.0
anaya8777

I can help you in Importing Rest API Data into SQL server using Azure Data Factory (ADF). Lets connect and discuss.

$50 AUD en 2 jours
(0 Commentaires)
0.0
avetech2013

Hello Employer, How are you? Hope you are in your best spirits. I have 5 years of project management and virtual assistance experience in various industries. In my 10 years of IT programming experience working on t Plus

$30 AUD en 7 jours
(0 Commentaires)
0.0
fl0colin

For this task, we can use pagination rules to achieve your needs. I have tested with the example API you shared. Dataflow does not support range, but we can use one copy activity follow by your dataflow to flatten the Plus

$40 AUD en 5 jours
(0 Commentaires)
0.0