Newlines #254
Merged
Newlines #254
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
The df2sd() method streams data from the data frame over to SAS to output into a SAS Data Set via STDIN and the datalines statement of a data step (in most access methods). This is all great except for when a char columns contains embedded newline characters (LF and/or CR). These characters always are considered the next input line by the data step. TERMSTR= is an option that can be used to change this default character, but on;y for file descriptors other than STDIN (socket or disk access methods, ...). So, to support this, I've added the ability to convert LF and CR to other values (x01 and x02 by default) before streaming them over, so SAS doesn't get tripped up parsing, and in the datastep (after being read) convert them back so they are stored. as was. in the data set. I've also added support to be able to override the default values, just in case that's ever needed. Shouldn't be for actual character data.
Tom