Merge pull request #11 from SASPAC/dev

The BasePlus package [ver. 1.19.1]

README.md

@@ -21,9 +21,15 @@ format x bool.;
 %rainCloudPlot(sashelp.cars,DriveTrain,Invoice)
 
 %zipLibrary(sashelp,libOut=work)
+
+%bpPIPE(ls -la ~/)
+
+%dirsAndFiles(C:\SAS_WORK\,ODS=work.result)
 ```
 and more.
 
-SHA256 digest for the latest version of `BasePlus`: EBA9EDB3D50D854288970CC0E965DA6AD5B057F6E6433EEBEC4A02B9A25CF6E2
+SHA256 digest for the latest version of `BasePlus`: F*B5BF05531BF78DCEBC436BD93311FED0436D83AA3D106ABFBAD96B04C7D63DF2
 
 [**Documentation for BasePlus**](./baseplus.md "Documentation for BasePlus")
+
+To work with a package use the [**SAS Packages Framework**](https://github.com/yabwon/SAS_PACKAGES/blob/main/README.md "SPFinit").

baseplus.md

@@ -49,14 +49,14 @@
   * [`%LDsNm()` macro](#ldsnm-macro)
   * [`%LVarNm()` macro](#lvarnm-macro)
   * [`%LVarNmLab()` macro](#lvarnmlab-macro)
-
+  * [`%bpPIPE()` macro](#bppipe-macro)
-  
+  * [`%dirsAndFiles()` macro](#dirsandfiles-macro)
   
   * [License](#license)
   
 ---
 
-# The BasePlus package [ver. 1.17.2] <a name="baseplus-package"></a> ###############################################
+# The BasePlus package [ver. 1.19.1] <a name="baseplus-package"></a> ###############################################
 
 The **BasePlus** package implements useful
 functions and functionalities I miss in the BASE SAS.
@@ -75,7 +75,8 @@ Kudos to all who inspired me to generate this package:
 *Allan Bowe*,
 *Anamaria Calai*,
 *Michal Ludwicki*,
-*Quentin McMullen*.
+*Quentin McMullen*,
+*Kurt Bremser*.
 
 Recording from the SAS Explore 2022 conference: [A BasePlus Package for SAS](https://communities.sas.com/t5/SAS-Explore-Presentations/A-BasePlus-Package-for-SAS/ta-p/838246 "A BasePlus Package for SAS") (September 27th-29th, 2022).
 
@@ -220,63 +221,79 @@ data MyNextDataset;
 run;
 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
 
+**Example 12**: List, to the log, content of `home` directory.
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
+%bpPIPE(ls -la ~/)
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+
+**EXAMPLE 13** Get list of all files and directories from `C:\SAS_WORK\`:
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
+%dirsAndFiles(C:\SAS_WORK\,ODS=work.result)
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+
 ---
 
 Package contains: 
-1.   macro      deduplistc 
+1.   macro      bppipe 
-2.   macro      deduplistp 
+2.   macro      deduplistc 
-3.   macro      deduplists 
+3.   macro      deduplistp 
-4.   macro      deduplistx 
+4.   macro      deduplists 
-5.   macro      functionexists 
+5.   macro      deduplistx 
-6.   macro      getvars 
+6.   macro      dirsandfiles 
-7.   macro      ldsn 
+7.   macro      functionexists 
-8.   macro      ldsnm 
+8.   macro      getvars 
-9.   macro      lvarnm 
+9.   macro      ldsn 
-10.  macro      lvarnmlab 
+10.  macro      ldsnm 
-11.  macro      qdeduplistx 
+11.  macro      lvarnm 
-12.  macro      qgetvars 
+12.  macro      lvarnmlab 
-13.  macro      qzipevalf 
+13.  macro      qdeduplistx 
-14.  macro      raincloudplot 
+14.  macro      qgetvars 
-15.  macro      symdelglobal 
+15.  macro      qzipevalf 
-16.  macro      unziplibrary 
+16.  macro      raincloudplot 
-17.  macro      zipevalf 
+17.  macro      symdelglobal 
-18.  macro      ziplibrary 
+18.  macro      unziplibrary 
-19.  format     bool 
+19.  macro      zipevalf 
-20.  format     boolz 
+20.  macro      ziplibrary 
-21.  format     ceil 
+21.  format     bool 
-22.  format     floor 
+22.  format     boolz 
-23.  format     int 
+23.  format     ceil 
-24.  functions  arrfill 
+24.  format     floor 
-25.  functions  arrfillc 
+25.  format     int 
-26.  functions  arrmissfill 
+26.  functions  arrfill 
-27.  functions  arrmissfillc 
+27.  functions  arrfillc 
-28.  functions  arrmisstoleft 
+28.  functions  arrmissfill 
-29.  functions  arrmisstoleftc 
+29.  functions  arrmissfillc 
-30.  functions  arrmisstoright 
+30.  functions  arrmisstoleft 
-31.  functions  arrmisstorightc 
+31.  functions  arrmisstoleftc 
-32.  functions  bracketsc 
+32.  functions  arrmisstoright 
-33.  functions  bracketsn 
+33.  functions  arrmisstorightc 
-34.  functions  catxfc 
+34.  functions  bracketsc 
-35.  functions  catxfi 
+35.  functions  bracketsn 
-36.  functions  catxfj 
+36.  functions  catxfc 
-37.  functions  catxfn 
+37.  functions  catxfi 
-38.  functions  deldataset 
+38.  functions  catxfj 
-39.  functions  semicolonc 
+39.  functions  catxfn 
-40.  functions  semicolonn 
+40.  functions  deldataset 
-41.  format     brackets 
+41.  functions  semicolonc 
-42.  format     semicolon 
+42.  functions  semicolonn 
-43.  proto      qsortincbyprocproto 
+43.  format     brackets 
-44.  functions  frommissingtonumberbs 
+44.  format     semicolon 
-45.  functions  fromnumbertomissing 
+45.  proto      qsortincbyprocproto 
-46.  functions  quicksort4notmiss 
+46.  functions  frommissingtonumberbs 
-47.  functions  quicksorthash 
+47.  functions  fromnumbertomissing 
-48.  functions  quicksorthashsddv 
+48.  functions  quicksort4notmiss 
-49.  functions  quicksortlight 
+49.  functions  quicksorthash 
+50.  functions  quicksorthashsddv 
+51.  functions  quicksortlight 
 
-*SAS package generated by generatePackage, version 20221121*
+Package contains additional content, run:  %loadPackageAddCnt(BasePlus)  to load it
+or look for the baseplus_AdditionalContent directory in the Packages fileref
+localization (only if additional content was deployed during the installation process).
+
+* SAS package generated by generatePackage, version 20230411 *
 
 The SHA256 hash digest for package BasePlus: 
-`EBA9EDB3D50D854288970CC0E965DA6AD5B057F6E6433EEBEC4A02B9A25CF6E2` 
+`F*B5BF05531BF78DCEBC436BD93311FED0436D83AA3D106ABFBAD96B04C7D63DF2` 
 
 ---
 # Content description ############################################################################################
@@ -3932,6 +3949,185 @@ The basic syntax is the following, the `<...>` means optional parameters:
 )
 ~~~~~~~~~~~~~~~~~~~~~~~
 
+---
+
+## >>> `%bpPIPE()` macro: <<< <a name="bppipe-macro"></a> #######################  
+
+The bpPIPE() [Base Plus PIPE] macro executes OS command
+and print to the log output of the execution.
+
+Under the hood it uses `_` filename reference to PIPE device.
+
+### SYNTAX: ###################################################################
+
+The basic syntax is the following, the `<...>` means optional parameters:
+~~~~~~~~~~~~~~~~~~~~~~~sas
+%bpPIPE( <OS command goes here> )
+~~~~~~~~~~~~~~~~~~~~~~~
+
+**Arguments description**:
+
+* **NO Arguments**    - Everything inside brackets is treated as an OS command.
+
+---
+
+### EXAMPLES AND USECASES: ####################################################
+
+**EXAMPLE 1.** List, to the log, content of D and C drives:
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
+  %bpPIPE(D: & dir & dir "C:\")
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+
+
+**EXAMPLE 2.** List, to the log, content of `home` directory:
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
+  %bpPIPE(ls -halt ~/)
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+
+---
+
+## >>> `%dirsAndFiles()` macro: <<< <a name="dirsandfiles-macro"></a> #######################  
+
+The `%dirsAndFiles()` macro allows to extract info about all files 
+and subdirectories of a given `root` directory. 
+
+The extracted info may be just a list of files and subdirectories or, if 
+the `details=` parameter is set to 1, additional operating system information 
+is extracted (information is OSS dependent and gives different results for Linux 
+and for Windows)
+
+The extracted info can be narrowed down to files (`keepFiles=1`) or to 
+directories (`keepDirs=1`) if need be.
+
+The extracted info can be presented in wide or long format (`longFormat=1`).
+
+The extracted info for files can be narrowed down to only files with particular
+extension, for example: `fileExt=sas7bdat`.
+
+The extracted info can be narrowed down maximal path depth 
+by setting up the `maxDepth=` parameter.
+
+See examples below for the details.
+
+### REFERENCES: ###################################################################
+
+The macro is based on Kurt Bremser's "*Talking to Your Host*" article 
+presented at WUSS 2022 conference.
+
+The article is available [here](https://communities.sas.com/t5/SAS-User-Groups-Library/WUSS-Presentation-Talking-to-Your-Host/ta-p/838344)
+and also as an additional content of this package.
+The paper was awarded the "Best Paper Award - Programming".
+
+### SYNTAX: ###################################################################
+
+The basic syntax is the following, the `<...>` means optional parameters:
+~~~~~~~~~~~~~~~~~~~~~~~sas
+%dirsAndFiles(
+    root
+  <,ODS=>
+  <,details=>
+  <,keepDirs=>
+  <,keepFiles=>
+  <,longFormat=>
+  <,fileExt=>
+  <,maxDepth=>
+)
+~~~~~~~~~~~~~~~~~~~~~~~
+
+**Arguments description**:
+
+1. `root`                     - *Required*, path to be searched
+                                for information.
+
+* `ODS=work.dirsAndFilesInfo` - *Optional*, output data set, 
+                                name of a dataset to store information.
+
+* `details=0`                 - *Optional*, indicates if detailed info 
+                                 will be collected, `1` = yes, `0` = no.
+
+* `keepDirs=1`                - *Optional*, indicates if directories info 
+                                will be collected, `1` = yes, `0` = no.
+
+* `keepFiles=1`               - *Optional*, indicates if files info 
+                                will be collected, `1` = yes, `0` = no.
+
+* `longFormat=0`              - *Optional*, indicates if output be 
+                                in long format, `1` = yes, `0` = no.
+
+* `fileExt=`                  - *Optional*, if not missing then indicates 
+                                file extension to filter out results.
+                                
+* `maxDepth=0`                - *Optional*, if not zero then indicates
+                                maximum depth of search in the root path.
+
+---
+
+### EXAMPLES AND USECASES: ####################################################
+
+**EXAMPLE 1.** Get list of files and directories:
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
+%dirsAndFiles(C:\SAS_WORK\,ODS=work.result1)
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+
+
+**EXAMPLE 2.** Get detailed info:
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
+%dirsAndFiles(C:\SAS_WORK\,ODS=work.result2,details=1)
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+
+
+**EXAMPLE 3.** Get only files info:
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
+%dirsAndFiles(C:\SAS_WORK\,ODS=work.result3,keepDirs=0)
+
+%dirsAndFiles(C:\SAS_WORK\,ODS=work.result5,keepDirs=0,details=1)
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+
+
+**EXAMPLE 4.** Get only directories info:
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
+%dirsAndFiles(C:\SAS_WORK\,ODS=work.result4,keepFiles=0)
+
+%dirsAndFiles(C:\SAS_WORK\,ODS=work.result6,keepFiles=0,details=1)
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+
+
+**EXAMPLE 5.** Filter out by `sas` extension:
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
+%dirsAndFiles(~/,ODS=work.result7,fileExt=sas)
+
+%dirsAndFiles(~/,ODS=work.result8,fileExt=sas,details=1)
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+
+
+**EXAMPLE 6.** Keep result in the long format:
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
+%dirsAndFiles(~/,ODS=work.result9,details=1,longFormat=1)
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+
+
+**EXAMPLE 7.** Get info for maximum depth of 2:
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
+%dirsAndFiles(C:\SAS_WORK\,ODS=work.result10,details=1,maxDepth=2)
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+
+
+**EXAMPLE 8.** How locked/unavailable files are handled:
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
+%dirsAndFiles(%sysfunc(pathname(WORK)),ODS=work.result11,details=1)
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+
+
+**EXAMPLE 9.** Not existing directory:
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
+%dirsAndFiles(%sysfunc(pathname(WORK))/noSuchDir,ODS=work.result12,details=1)
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+
+
+
+
+
+
 ---
 
 ## License ####################################################################