Recently in the SAS Community Library: SAS' @Sundaresh1 highlights a sometimes overlooked task when applying document embeddings for purposes of similarity-based search. Normalisation of vectors helps obtain relevant matches.
Hi I have a file uploaded to a big data platform showing correct d.p but somehow when our clients see the same file via ODBC, the decimal place change from 4 to 2, how did that happen? Do I need to setup schema for showing data via ODBC or there is specific settings required dealing with?
... View more
Hi All
I have searched and searched the web for answers, but am just not winning. I am reading a json file with unicode characters that are causing the error "Some code points did not transcode.". Some of the specific values are:
- \"
- \udigits
I have tried this: filename test '/filepath/filename.json' encoding='UTF-8'; libname data JSON fileref=test ordinalcount=ALL;
but I still get the same error. Any ideas please? Unfortunately I cannot attach the file as it contains sensitive data.
... View more
Hi SAS Community,
I'm reaching out for some guidance on loading large .dat files into SAS Viya 4.
Our Process: Each semester, we generate census datasets from snapshots of data received as .dat files from IT. Previously, we used Base SAS programs to read these files from a Windows file server and convert them to SAS datasets.
Challenge: Since transitioning to SAS Viya 4, I'm encountering difficulties loading the .dat files, particularly with larger ones exceeding 100MB. I'm unable to load or copy them directly into SAS Viya.
Clarification: I'm copying the .dat files to "SAS Content," not the CAS server (I am unable to copy to cas). For this project my programs typically read data from the "SAS Content" location.
Specific Issue: Out of 19 .dat files, 17 successfully copy to the "SAS Content" path and able to convert them into sas datasets. However, the two remaining files (119MB and 153MB) fail to copy, resulting in an error (details provided below).
I'd greatly appreciate any insights or suggestions on how to approach loading/copying these large .dat files into SAS Viya 4. Any advice on alternative methods or configuration adjustments would be incredibly helpful.
Thank you for your time and support!
Sincerely,
Bhaskar
... View more
The deployment backup is failing in our SAS 9.4 M6 environment (OS: AIX). This is the only error in the log:
2024-04-23 14:40:48,770 [tomcat-http--17] ERROR [sasadm] com.sas.svcs.backup.spi.BackupServiceImpl - The backup failed
When I enabled debug logging, I saw some additional details:
2024-04-23 14:39:14,524 [executor-1] INFO [sasadm] com.sas.svcs.backup.dao.BackupServerHelperDAO - Received Status code: FAIL
2024-04-23 14:39:14,524 [executor-1] DEBUG [sasadm] com.sas.svcs.backup.dao.BackupServerHelperDAO - Log file path: /opt/sas/config/Lev3/Backup/Logs/2024-04-23T11_03_58/backup/ConfigDir
I checked the log inside ../ConfigDir. This is the error message:
2024-04-23 14:39:11,979 [main] ERROR com.sas.svcs.backup.server.BackupDriver - An exception while running the BackupServer executable, Exiting..... : SAS configuration directory backed failed.
Error Code: 999, Stack Trace: SAS configuration directory backed failed., java.lang.OutOfMemoryError: Java heap spacecom.sas.apps.content.migration.core.ContentMigrationAdapter.migrateContents(ContentMigrationAdapter.java:21) com.sas.svcs.backup.server.handler.LevconfigBackupHandler.execute(LevconfigBackupHandler.java:254)...
I tried increasing the jvm values for SASServer1_1 from Xmx4096m and Xms1024m to Xmx8192m and Xms4096m . But it did not resolve the issue. Anyone has any idea how to resolve this? The ../ConfigDir is in the compute server. Should I increase java heap space in compute? Thanks in advance!
... View more