Pfthb

I have some code (mostly not my original code), that I have running on my local PC anaconda juptyer Notebook environment. I need to scale up the processing so I am looking into Azure Databricks. There's 1 section of code that's running a python loop but utilizes an R library (stats), then passes the data through an R model (tbats). So 1 Jupyter notebook cell runs python & R code. Can this be done in Azure Databricks JNB's as well? I only found documentation that lets you change languages from cell to cell.

In a previous cell I have:

%r libarary(stats) 

So the library is imported (along with other R libs). However when I run the code below, I get "NameError: name 'stats' is not defined. I am wondering if it's the way databricks wants you to tell the cell the language you're using (%r, %python, etc.)

for customerid, dataForCustomer in original.groupby(by=['customer_id']):
 startYear = dataForCustomer.head(1).iloc[0].yr
 startMonth = dataForCustomer.head(1).iloc[0].mnth
 endYear = dataForCustomer.tail(1).iloc[0].yr
 endMonth = dataForCustomer.tail(1).iloc[0].mnth

 #Creating a time series object
 customerTS = stats.ts(dataForCustomer.usage.astype(int),
 start=base.c(startYear,startMonth),
 end=base.c(endYear, endMonth), 
 frequency=12)
 r.assign('customerTS', customerTS)

 ##Here comes the R code piece
 try:
 seasonal = r('''
 fit<-tbats(customerTS, seasonal.periods = 12, 
 use.parallel = TRUE)
 fit$seasonal
 ''')
 except: 
 seasonal = 1

 # APPEND DICTIONARY TO LIST (NOT DATA FRAME)
 df_list.append('customer_id': customerid, 'seasonal': seasonal)
 print(f' customerid | seasonal ')

seasonal_output = pa.DataFrame(df_list)

Thank you