Compare commits

..

23 Commits

Author SHA1 Message Date
yabwon
f7485ce6c4 **SAS Packages Framework**, version 20210528
**SAS Packages Framework**, version 20210528:

Help tags selection modified in the `%generatePackage()` macro.
New solution allows to write help tags surrounding comments in two ways.
The first (old) is:
```
/*** HELP START ***/
/*
comment
*/
/*** HELP END ***/
```

and the second (new):
```
/*** HELP START ***//*
comment
*//*** HELP END ***/
```
The second allows to print help info in log without `/*` and `*/` surrounding comments. It looks better and is easier for building `.md` files or other help documents (so you do not have to remove `/*` by hand).

Documentation updated.

The following packages were regenerated with new version of the SPF:
- BasePlus
- DFA
- dynMacroArray
- macroArray
- SQLinDS
2021-05-28 11:47:28 +02:00
yabwon
8f3cbe1b92 *SAS Packages Framework*, version 20210520
*SAS Packages Framework*, version 20210520

- SAS Global Forum 2021 refresh,
- ignore not `*.sas` files when generating the package.
2021-05-20 15:38:46 +02:00
Bart Jablonski
bc36780cee link to SAS Global Forum 2021 proceedings added
link to SAS Global Forum 2021 proceedings added
2021-05-18 10:29:22 +02:00
Bart Jablonski
3a0fc83433 link to SAS Global Forum 2021 video added 2021-05-16 22:32:06 +02:00
yabwon
b8905ca4a7 SAS Packages Framework, version 20210516
SAS Packages Framework, version 20210516

- explicit encoding added in zip filename reference in the %generatePacksge() macro
- minor spellings
2021-05-16 21:41:45 +02:00
yabwon
47426131a5 *SAS Packages Framework*, version 20210204
a spelling corrected
2021-04-26 20:33:20 +02:00
Bart Jablonski
8a23978694 Update README.md 2021-03-30 22:48:19 +02:00
yabwon
f3f3bc3688 Final version of SGF2021 article
Final version of SGF2021 article
2021-03-22 10:16:34 +01:00
yabwon
c2e06995f5 Documentation updated
Documentation updated:
- preprint of SAS Global Forum 2021 article added.
- files from the live demo added.
2021-02-05 22:44:01 +01:00
yabwon
40f3a00cb2 *SAS Packages Framework*, version 20210204
*SAS Packages Framework*, version 20210204

BugFix. In the testing part of the framework there may be situation when WorkspaceServer is not generating the log file. Manual log redirection was introduced.
2021-02-04 13:40:52 +01:00
yabwon
6f1f30fef9 *SAS Packages Framework*, version 20210203
*SAS Packages Framework*, version 20210203

Added test if during loading a macro from the package overwrites an existing macro in sasmacr catalog.
Documentation updated.
2021-02-03 21:12:17 +01:00
Bart Jablonski
78f202b150 Update README.md 2021-02-02 21:06:34 +01:00
yabwon
97d393bb71 SAS Packages Framework, version 20210122
SAS Packages Framework, version 20210122

New parameters to the `%installPackage()` macro added:
- `URLuser=` - A user name for the password protected URLs, no quotes needed.
- `URLpass=` - A password for the password protected URLs, no quotes needed.
- `URLoptions=` - Options for the `sourcePath` URLs filename. Consult the SAS documentation for the further details.
2021-01-22 16:46:27 +01:00
Bart Jablonski
98af4c8bc3 Update README.md 2021-01-17 21:15:55 +01:00
yabwon
c04d9c4eb2 DFA, version 0.5
DFA, version 0.5:
 - Optimisation of loading.
 - Documentation updated.
2021-01-17 21:05:14 +01:00
yabwon
8b65e85f3a Update Getting_Started_with_SAS_Packages.pdf 2021-01-11 14:14:58 +01:00
Bart Jablonski
582c12d908 Merge pull request #10 from yabwon/master
Master
2021-01-09 21:01:13 +01:00
yabwon
742e4ac3d3 **SAS Packages Framework**, version 20210109
**SAS Packages Framework**, version 20210109

Changes:
- type `formatS` added (mind the `S` at the end)
- testing extended:
  - test for existence of datasets
  - test for existence of macros

Documentation updated.

Packages recompiled with the new version of the SAS Packages Framework:
- `SQLinDS` (version 2.2)
- `macroArray` (version 0.8)
- `DFA` (version 0.4)
- `BasePlus` (version 0.991)
- `dynMacroArray` (version 0.2)
2021-01-09 17:22:32 +01:00
yabwon
74360b4cca DFA, version 0.4
Bitmaps added to the list of datastructures generaten by the DFA package.

New components:
-   proto      bit64andprotodfa
-   proto      bit64orprotodfa
-   function  bit64anddfa
-   function  bit64ordfa
-  macro      createdfbitmap
2020-12-29 22:32:32 +01:00
Bart Jablonski
aba2ee4f44 Update README.md 2020-12-26 22:10:17 +01:00
Bart Jablonski
55f4e35e0e Update README.md 2020-12-26 22:09:14 +01:00
Bart Jablonski
50f307f370 Merge pull request #9 from yabwon/main
SAS Packages Framework, version 20201209
2020-12-09 14:46:16 +01:00
Bart Jablonski
acd3a4872d Merge pull request #7 from yabwon/main
pull request
2020-12-07 20:45:48 +01:00
38 changed files with 1076 additions and 181 deletions

View File

@@ -1,6 +1,6 @@
MIT License
Copyright (c) since 2019 Bartosz Jablonski
Copyright (c) 2019 - 2021 Bartosz Jablonski
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal

View File

@@ -8,7 +8,7 @@ A **SAS package** is an automatically generated, single, stand alone *zip* file
The *purpose of a package* is to be a simple, and easy to access, code sharing medium, which will allow: on the one hand, to separate the code complex dependencies created by the developer from the user experience with the final product and, on the other hand, reduce developer's and user's unnecessary frustration related to a remote deployment process.
In this repository we are presenting the **SAS Packages Framework** which allows to develop and use SAS packages. The latest version of SPF is **`20201209`**.
In this repository we are presenting the **SAS Packages Framework** which allows to develop and use SAS packages. **The latest version** of SPF is **`20210528`**.
To get started with SAS Packages try this [**`Getting Started with SAS Packages`**](https://github.com/yabwon/SAS_PACKAGES/blob/main/SPF/Documentation/Getting_Started_with_SAS_Packages.pdf "Getting Started with SAS Packages") presentation (see the `./SPF/Documentation` directory).
@@ -16,11 +16,13 @@ The documentation and more advance reading would be the [**`SAS(r) packages - th
Short description of the SAS Packages Framework macros can be found [here](https://github.com/yabwon/SAS_PACKAGES/blob/main/SPF/SPFinit.md "Short description of the SAS Packages Framework macros")
**General overview video:**
**Videos** (the newer the better):
- [SAS Global Forum 2020 V.E.](https://www.youtube.com/watch?v=qCkb-bx0Dv8&t=0s "SGF2020") (April 2020)
- [Sasensei International Dojo](https://www.youtube.com/watch?v=BFhdUBQgjYQ&t=0s "SID no. 1") (April 2020)
- [SAS dla Administratorów i Praktyków 2020](https://www.youtube.com/watch?v=mXuep2k48Z8&feature=youtu.be&t=0s "SASAiP2020") (October 2020, in Polish)
- [Boston Area SAS Users Group webinar](https://us02web.zoom.us/rec/share/p6ZpCsvc5YZDQGpLOOLOB4zyNGA4vjfjJcNhwaGQ7jKKR00Z_bmeCcBkcwkut6Pr.Q6UoueYAOcv6dPQf "BASUG") (November 2020)
- [SAS Global Forum 2021 V.E.](https://www.youtube.com/watch?v=hqexaQtGw88 "SGF2021") (May 20th, 2021)
---
### The User:
@@ -32,7 +34,8 @@ and then either:
- Download the `SPFinit.sas` file (the SAS Packages Framework) into the local packages folder.
- \[Optional\] Manually download the `<packageName>.zip` file into the local packages folder.
- and Execute:
```
```sas
filename packages "<directory/containing/packages/>"; /* setup directory for packages */
%include packages(SPFinit.sas); /* enable the framework */
@@ -44,7 +47,7 @@ filename packages "<directory/containing/packages/>"; /* setup directory for pac
or if you need it just for "one time" only Execute:
```
```sas
filename packages "%sysfunc(pathname(work))"; /* setup temporary directory for packages in the WORK */
filename SPFinit url "https://raw.githubusercontent.com/yabwon/SAS_PACKAGES/main/SPF/SPFinit.sas";
%include SPFinit; /* enable the framework */
@@ -54,13 +57,14 @@ filename SPFinit url "https://raw.githubusercontent.com/yabwon/SAS_PACKAGES/main
%loadPackage(packageName) /* load the package content into the SAS session */
```
[**Workshop video for the User**](https://youtu.be/qX_-HJ76g8Y)\[May 6th, 2020\] [a bit outdated but gives the idea how it works]
[**Workshop video for the User**](https://youtu.be/qX_-HJ76g8Y) \[May 6th, 2020\] [a bit outdated but gives the idea how it works]
---
### The Developer:
To create your own package:
- Read the [**`SAS(r) packages - the way to share (a how to)- Paper 4725-2020 - extended.pdf`**](https://github.com/yabwon/SAS_PACKAGES/blob/main/SPF/Documentation/SAS(r)%20packages%20-%20the%20way%20to%20share%20(a%20how%20to)-%20Paper%204725-2020%20-%20extended.pdf "SAS packages - the way to share") to learn more details.
- Read the [**`SAS Packages - The Way to Share (a How-To) - Paper 4725-2020 - extended version`**](https://github.com/yabwon/SAS_PACKAGES/blob/main/SPF/Documentation/SAS(r)%20packages%20-%20the%20way%20to%20share%20(a%20how%20to)-%20Paper%204725-2020%20-%20extended.pdf "SAS packages - the way to share") article to learn more details.
- Read the **`My First SAS Package: A How-To - Paper 1079-2021`** article available at communities.sas.com [**`here`**](https://communities.sas.com/t5/SAS-Global-Forum-Proceedings/My-First-SAS-Package-A-How-To/ta-p/726319 "My First SAS Package: A How-To") or locally [**`here`**](https://github.com/yabwon/SAS_PACKAGES/blob/main/SPF/Documentation/Paper_1079-2021/My%20First%20SAS%20Package%20-%20a%20How%20To.pdf "My First SAS Package: A How-To")
- Download and use the `SPFinit.sas` file (the SAS Packages Framework), the part of the framework required for *testing* is there too.
---
@@ -95,12 +99,12 @@ The List:
Currently the following packages are available (see the `./packages` directory):
- **SQLinDS**\[2.2\], based on Mike Rhoads' article *Use the Full Power of SAS in Your Function-Style Macros*. The package allows to write SQL queries in the data step, e.g.
```
```sas
data class;
set %SQL(select * from sashelp.class order by age);
run;
```
SHA256 digest for SQLinDS: CE1A266B9030E5E336B45F53DF483F6913FD8AE88A2884CEE88BEEF621FDBD78
SHA256 digest for SQLinDS: 1853CD6262CF66582A33C373AA612CA714B61CB88A1C51745E7A57D5A03C39B4
[Documentation for SQLinDS](https://github.com/yabwon/SAS_PACKAGES/blob/main/packages/sqlinds.md "Documentation for SQLinDS")
@@ -110,14 +114,14 @@ SHA256 digest for MacroCore: A23C29529F3CE7D0C8BEE9545C5D22D5B5594907547374A5135
[Documentation for MacroCore](https://core.sasjs.io "Documentation for MacroCore")
- **DFA** (Dynamic Function Arrays)\[0.3\], contains set of macros and FCMP functions which implement: a dynamically allocated array, a stack, a fifo queue, an ordered stack, and a priority queue, run `%helpPackage(DFA,createDFArray)` to find examples.
- **DFA** (Dynamic Function Arrays)\[0.5\], contains set of macros and FCMP functions which implement: a dynamically allocated array, a stack, a fifo queue, an ordered stack, and a priority queue, run `%helpPackage(DFA,createDFArray)` to find examples.
SHA256 digest for DFA: 1FC8D030D576C33F1B5DEB27E17534946209BC148D57A1357CA025ED1E69AEB8
SHA256 digest for DFA: 22AB51B85E3344B8C0FB7AF164247881B656F5CBA88BBA974AD8BC41ED79327F
[Documentation for DFA](https://github.com/yabwon/SAS_PACKAGES/blob/main/packages/dfa.md "Documentation for DFA")
- **macroArray**\[0.8\], implementation of an array concept in a macrolanguage, e.g.
```
```sas
%array(ABC[17] (111:127), macarray=Y);
%macro test();
@@ -135,13 +139,13 @@ SHA256 digest for DFA: 1FC8D030D576C33F1B5DEB27E17534946209BC148D57A1357CA025ED1
which = 1:H:2
);
```
SHA256 digest for macroArray: AC3AD58AFBBE459616743DC6346330BD8DD33FBA8CDD595423F181B67D0475BC
SHA256 digest for macroArray: 849629D3AF3FE3AB45D86990E303F1D5E4D5F9F31C8ED6864C95B0DFAADCA445
[Documentation for macroArray](https://github.com/yabwon/SAS_PACKAGES/blob/main/packages/macroarray.md "Documentation for macroArray")
- **BasePlus**\[0.991\] adds a bunch of functionalities I am missing in BASE SAS, such as:
```
```sas
call arrMissToRight(myArray);
call arrFillMiss(17, myArray);
call arrFill(42, myArray);
@@ -154,12 +158,12 @@ format x bool.;
%put %getVars(sashelp.class, pattern = ght$, sep = +, varRange = _numeric_);
```
SHA256 digest for BasePlus: 9EA40F72191D1916189F043315CA519F6E42CEB05C186F7653AE464D21D21CFB
SHA256 digest for BasePlus: A321A4BC54D444B82575EC5D443553A096557AD69DC171D578A330277E67637A
[Documentation for BasePlus](https://github.com/yabwon/SAS_PACKAGES/blob/main/packages/baseplus.md "Documentation for BasePlus")
- **dynMacroArray**\[0.2\], set of macros (wrappers for a hash table) emulating dynamic array in the data step (macro predecessor of DFA)
SHA256 digest for dynMacroArray: 5E8CCC88CC048A0B564CEE37C6CF4013857D9CFF3FA1B6B9AD6F719D08B30005
SHA256 digest for dynMacroArray: 67956116578E71327748B7EB3DAFF9D872DBC6F6EDD0DC11B7CF2A54FDA71785
### ======

View File

@@ -0,0 +1,80 @@
/*one library "myLib" created in the (same named) subderectory of the "WORK" directory.*/
data _null_;
length rc0 $ 32767 rc1 rc2 8;
lib = "myLib";
rc0 = DCREATE(lib, "%sysfunc(pathname(work))/");
put rc0 = ;
rc1 = LIBNAME(lib, "%sysfunc(pathname(work))/" !! lib, "BASE");
rc2 = LIBREF (lib);
if rc2 NE 0 then
rc1 = LIBNAME(lib, "%sysfunc(pathname(work))", "BASE");
run;
libname myLib LIST;
/*two FCMP functions: "F1" and "F2", */
proc FCMP outlib = work.f.p;
function F1(n);
return (n+1);
endsub;
function F2(n);
return (n+2);
endsub;
run;
options cmplib = work.f;
/*one numeric format "fmtNum" and informat "infNum", */
proc FORMAT;
value fmtNum
low -< 0 = "negative"
0 = "zero"
0 <- high = "positive"
other = "missing"
;
invalue infNum
"negative" = -1
"zero" = 0
"positive" = 1
"missing" = .
other = 42
;
run;
/*one exemplary small dataset "myLib.smallDataset", and*/
data myLib.smallDataset;
do n = ., -1, 0, 1;
m = put(n, fmtNum.);
output;
end;
run;
/*one exemplary bigger dataset "myLib.biggerDataset".*/
data myLib.biggerDataset;
do i = ., -1e6 to 1e6;
j = put(i, fmtNum.);
k = ranuni(17);
output;
end;
run;
/*two macros: "mcrOne" and "mcrTwo" */
%macro mcrOne();
%put **Hi! This is macro &sysmacroname.**;
data _null_;
set myLib.smallDataset;
p = f1(n);
p + f2(n);
put (n p) (= fmtNum.);
run;
%mend mcrOne;
%macro mcrTwo(m=mcrOne);
%put **This is macro &sysmacroname.**;
%put **and I am calling the &m.**;
%&m.()
%put The answer is: %sysfunc(inputn("I don't know...", infNum.));
%mend mcrTwo;
/* %mcrTwo() */

View File

@@ -0,0 +1,4 @@
filename packages "~/saspackages";
%include packages(SPFinit.sas);
%generatePackage(~/saspackages/myPackage)

View File

@@ -0,0 +1,7 @@
filename packages "~/saspackages";
filename SPFinit url
"https://raw.githubusercontent.com/yabwon/SAS_PACKAGES/main/SPF/SPFinit.sas";
%include SPFinit;
%installPackage(SPFinit)

View File

@@ -0,0 +1,18 @@
/*** HELP START ***/
/*
`myLib` library
*/
/*** HELP END ***/
data _null_;
length rc0 $ 32767 rc1 rc2 8;
lib = "myLib";
rc0 = DCREATE(lib, "%sysfunc(pathname(work))/");
put rc0 = ;
rc1 = LIBNAME(lib, "%sysfunc(pathname(work))/" !! lib, "BASE");
rc2 = LIBREF (lib);
if rc2 NE 0 then
rc1 = LIBNAME(lib, "%sysfunc(pathname(work))", "BASE");
run;
libname myLib LIST;

View File

@@ -0,0 +1,9 @@
/*** HELP START ***/
/*
`F1` function
*/
/*** HELP END ***/
function F1(n);
return (n+1);
endsub;

View File

@@ -0,0 +1,9 @@
/*** HELP START ***/
/*
`F2` function
*/
/*** HELP END ***/
function F2(n);
return (n+2);
endsub;

View File

@@ -0,0 +1,12 @@
/*** HELP START ***/
/*
`fmtNum` format
*/
/*** HELP END ***/
value fmtNum
low -< 0 = "negative"
0 = "zero"
0 <- high = "positive"
other = "missing"
;

View File

@@ -0,0 +1,13 @@
/*** HELP START ***/
/*
`infNum` informat
*/
/*** HELP END ***/
invalue infNum
"negative" = -1
"zero" = 0
"positive" = 1
"missing" = .
other = 42
;

View File

@@ -0,0 +1,12 @@
/*** HELP START ***/
/*
`myLib.smallDataset` data
*/
/*** HELP END ***/
data myLib.smallDataset;
do n = ., -1, 0, 1;
m = put(n, fmtNum.);
output;
end;
run;

View File

@@ -0,0 +1,13 @@
/*** HELP START ***/
/*
`myLib.biggerDataset` data
*/
/*** HELP END ***/
data myLib.biggerDataset;
do i = ., -1e6 to 1e6;
j = put(i, fmtNum.);
k = ranuni(17);
output;
end;
run;

View File

@@ -0,0 +1,15 @@
/*** HELP START ***/
/*
`mcrOne` macro
*/
/*** HELP END ***/
%macro mcrOne();
%put **Hi! This is macro &sysmacroname.**;
data _null_;
set myLib.smallDataset;
p = f1(n);
p + f2(n);
put (n p) (= fmtNum.);
run;
%mend mcrOne;

View File

@@ -0,0 +1,30 @@
/*** HELP START ***/
/*
## General Info: ##
The `%mcrTwo()` macro is the main macro of the package.
It has one key-value parameter `m` with default value `mcrOne`.
*/
/*** HELP END ***/
%macro mcrTwo(m=mcrOne);
%put **This is macro &sysmacroname.**;
%put **and I am calling the &m.**;
%&m.()
%put The answer is: %sysfunc(inputn("I don't know...", infNum.));
%mend mcrTwo;
/*** HELP START ***/
/*
## Examples: ##
Example 1. Basic use-case:
~~~~~~~~~~~~~~~~~~~~~~~~~~
%mcrTwo(m=mcrOne)
~~~~~~~~~~~~~~~~~~~~~~~~~~
*/
/*** HELP END ***/

View File

@@ -0,0 +1,21 @@
Type: Package
Package: myPackage
Title: My first SAS package.
Version: 1.0
Author: John Smith (john.smith@mail.com)
Maintainer: Jane Smith (jane.smith@mail.com)
License: MIT
Encoding: UTF8
Required: "Base SAS Software"
DESCRIPTION START:
## The myPackage ##
The `myPackage` is my first SAS package and
for sure it won't be the last package!
It was created during SAS Global Forum 2021
virtual event.
It helps me to share my code with other SAS users!
DESCRIPTION END:

View File

@@ -0,0 +1,2 @@
%mcrTwo(m=mcrOne)

View File

@@ -0,0 +1,14 @@
## General Info: ##
The `%mcrTwo()` macro is the main macro of the package.
It has one key-value parameter `m` with default value `mcrOne`.
## Examples: ##
Example 1. Basic use-case:
~~~~~~~~~~~~~~~~~~~~~~~~~~
%mcrTwo(m=mcrOne)
~~~~~~~~~~~~~~~~~~~~~~~~~~

View File

@@ -20,7 +20,7 @@ A **SAS package** is an automatically generated, single, stand alone *zip* file
The *purpose of a package* is to be a simple, and easy to access, code sharing medium, which will allow: on the one hand, to separate the code complex dependencies created by the developer from the user experience with the final product and, on the other hand, reduce developer's and user's unnecessary frustration related to a remote deployment process.
In this repository we are presenting the **SAS Packages Framework** which allows to develop and use SAS packages. The latest version of SPF is **`20201209`**.
In this repository we are presenting the **SAS Packages Framework** which allows to develop and use SAS packages. The latest version of SPF is **`20210528`**.
**To get started with SAS Packages** try this [**`Getting Started with SAS Packages`**](https://github.com/yabwon/SAS_PACKAGES/blob/main/SPF/Documentation/Getting_Started_with_SAS_Packages.pdf "Getting Started with SAS Packages") presentation (see the `./SPF/Documentation` directory).
@@ -38,7 +38,7 @@ After assigning the directory do not change them when using the SPF since it may
## This is short help information for the `installPackage` macro <a name="installpackage"></a>
--------------------------------------------------------------------------------------------
Macro to install SAS packages, version `20201209`
Macro to install SAS packages, version `20210528`
A SAS package is a zip file containing a group
of SAS codes (macros, functions, data steps generating
@@ -60,13 +60,22 @@ After assigning the directory do not change them when using the SPF since it may
If the package name is *SPFinit* or *SASPackagesFramework*
then the framework itself is downloaded.
- `sourcePath=` Location of the package, e.g. "www.some.web.page/" (mind the "/" at the end of the path!) <br>
Current default location for packages is: <br> `https://raw.githubusercontent.com/yabwon/SAS_PACKAGES/main/packages/` <br>
Current default location for the framework is: <br> `https://raw.githubusercontent.com/yabwon/SAS_PACKAGES/main/SPF/`
- `sourcePath=` Location of the package, e.g. "www.some.web.page/" (mind the "/" at the end of the path!)
Current default location for packages is:
`https://raw.githubusercontent.com/yabwon/SAS_PACKAGES/main/packages/`
Current default location for the framework is:
`https://raw.githubusercontent.com/yabwon/SAS_PACKAGES/main/SPF/`
- `replace=` With default value of `1` it causes existing package file
to be replaceed by new downloaded file.
- `URLuser=` A user name for the password protected URLs, no quotes needed.
- `URLpass=` A password for the password protected URLs, no quotes needed.
- `URLoptions=` Options for the `sourcePath` URLs filename. Consult the SAS
documentation for the further details.
--------------------------------------------------------------------------------------------
Visit: `https://github.com/yabwon/SAS_PACKAGES/tree/main/SPF/Documentation` to learn more.
@@ -95,7 +104,7 @@ filename packages "C:/SAS_PACKAGES"; %* setup a directory for packages;
## This is short help information for the `helpPackage` macro <a name="helppackage"></a>
-------------------------------------------------------------------------------
Macro to get help about SAS packages, version `20201209`
Macro to get help about SAS packages, version `20210528`
A SAS package is a zip file containing a group
of SAS codes (macros, functions, data steps generating
@@ -165,7 +174,7 @@ filename packages "C:/SAS_PACKAGES"; %* setup a directory for packages;
## This is short help information for the `loadPackage` macro <a name="loadpackage"></a>
-------------------------------------------------------------------------------
Macro to *load* SAS packages, version `20201209`
Macro to *load* SAS packages, version `20210528`
A SAS package is a zip file containing a group
of SAS codes (macros, functions, data steps generating
@@ -238,7 +247,7 @@ filename packages "C:/SAS_PACKAGES"; %* setup a directory for packages;
## This is short help information for the `loadPackageS` macro <a name="loadpackages"></a>
-------------------------------------------------------------------------------
Macro wrapper for the loadPackage macro, version `20201209`
Macro wrapper for the loadPackage macro, version `20210528`
A SAS package is a zip file containing a group
of SAS codes (macros, functions, data steps generating
@@ -287,7 +296,7 @@ filename packages "C:/SAS_PACKAGES"; %* setup a directory for packages;
## This is short help information for the `unloadPackage` macro <a name="unloadpackage"></a>
-------------------------------------------------------------------------------
Macro to unload SAS packages, version `20201209`
Macro to unload SAS packages, version `20210528`
A SAS package is a zip file containing a group
of SAS codes (macros, functions, data steps generating
@@ -352,7 +361,7 @@ filename packages "C:/SAS_PACKAGES"; %* setup a directory for packages;
## This is short help information for the `listPackages` macro <a name="listpackages"></a>
-----------------------------------------------------------------------------------------
Macro to list available SAS packages, version `20201209`
Macro to list available SAS packages, version `20210528`
A SAS package is a zip file containing a group
of SAS codes (macros, functions, data steps generating
@@ -393,7 +402,7 @@ filename packages "C:/SAS_PACKAGES"; %* setup a directory for packages;
## This is short help information for the `verifyPackage` macro <a name="verifypackage"></a>
-------------------------------------------------------------------------------
Macro to verify SAS package with it hash digest, version `20201209`
Macro to verify SAS package with it hash digest, version `20210528`
A SAS package is a zip file containing a group
of SAS codes (macros, functions, data steps generating
@@ -439,14 +448,14 @@ filename packages "C:/SAS_PACKAGES"; %* set-up a directory for packages;
%include packages(SPFinit.sas); %* enable the framework;
%installPackage(SQLinDS) %* install the package from the Internet;
%verifPackage(SQLinDS, %* verify the package with provided hash;
%verifyPackage(SQLinDS, %* verify the package with provided hash;
hash=HDA478ANJ3HKHRY327FGE88HF89VH89HFFFV73GCV98RF390VB4)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
## This is short help information for the `previewPackage` macro <a name="previewpackage"></a>
-------------------------------------------------------------------------------
Macro to get previwe of a SAS packages, version `20201209`
Macro to get previwe of a SAS packages, version `20210528`
A SAS package is a zip file containing a group
of SAS codes (macros, functions, data steps generating
@@ -507,13 +516,13 @@ filename packages "C:/SAS_PACKAGES"; %* setup a directory for packages;
%include packages(SPFinit.sas); %* enable the framework;
%installPackage(SQLinDS) %* install the package from the Internet;
%previewpPackage(SQLinDS) %* get content of the package;
%previewPackage(SQLinDS) %* get content of the package;
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
## This is short help information for the `generatePackage` macro <a name="generatepackage"></a>
-------------------------------------------------------------------------------
Macro to generate SAS packages, version `20201209`
Macro to generate SAS packages, version `20210528`
A SAS package is a zip file containing a group
of SAS codes (macros, functions, data steps generating
@@ -598,6 +607,8 @@ can be used to order multiple types in the way you wish.
The "tree structure" of the folder could be for example as follows:
All files have to have `.sas` extension. Other files are ignored.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
<packageName>
..

View File

@@ -12,7 +12,7 @@
/* */
/* Here is the official version: */
/*
Copyright (c) 2019 - 2020 Bartosz Jablonski (yabwon@gmail.com)
Copyright (c) 2019 - 2021 Bartosz Jablonski (yabwon@gmail.com)
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
@@ -42,7 +42,7 @@
- to unload, or
- to generate SAS packages.
Version 20201209.
Version 20210528.
See examples below.
A SAS package is a zip file containing a group of files
@@ -81,7 +81,7 @@
*/
)/secure
/*** HELP END ***/
des = 'Macro to load SAS package, version 20201209. Run %loadPackage() for help info.'
des = 'Macro to load SAS package, version 20210528. Run %loadPackage() for help info.'
;
%if (%superq(packageName) = ) OR (%qupcase(&packageName.) = HELP) %then
%do;
@@ -96,7 +96,7 @@ des = 'Macro to load SAS package, version 20201209. Run %loadPackage() for help
%put ### This is short help information for the `loadPackage` macro #;
%put #-------------------------------------------------------------------------------#;
%put # #;
%put # Macro to *load* SAS packages, version `20201209` #;
%put # Macro to *load* SAS packages, version `20210528` #;
%put # #;
%put # A SAS package is a zip file containing a group #;
%put # of SAS codes (macros, functions, data steps generating #;
@@ -251,7 +251,7 @@ des = 'Macro to load SAS package, version 20201209. Run %loadPackage() for help
*/
)/secure
/*** HELP END ***/
des = 'Macro to unload SAS package, version 20201209. Run %unloadPackage() for help info.'
des = 'Macro to unload SAS package, version 20210528. Run %unloadPackage() for help info.'
;
%if (%superq(packageName) = ) OR (%qupcase(&packageName.) = HELP) %then
%do;
@@ -266,7 +266,7 @@ des = 'Macro to unload SAS package, version 20201209. Run %unloadPackage() for h
%put ### This is short help information for the `unloadPackage` macro #;
%put #-------------------------------------------------------------------------------#;
%put # #;
%put # Macro to unload SAS packages, version `20201209` #;
%put # Macro to unload SAS packages, version `20210528` #;
%put # #;
%put # A SAS package is a zip file containing a group #;
%put # of SAS codes (macros, functions, data steps generating #;
@@ -390,7 +390,7 @@ des = 'Macro to unload SAS package, version 20201209. Run %unloadPackage() for h
*/
)/secure
/*** HELP END ***/
des = 'Macro to get help about SAS package, version 20201209. Run %helpPackage() for help info.'
des = 'Macro to get help about SAS package, version 20210528. Run %helpPackage() for help info.'
;
%if (%superq(packageName) = ) OR (%qupcase(&packageName.) = HELP) %then
%do;
@@ -405,7 +405,7 @@ des = 'Macro to get help about SAS package, version 20201209. Run %helpPackage()
%put ### This is short help information for the `helpPackage` macro #;
%put #-------------------------------------------------------------------------------#;
%put # #;
%put # Macro to get help about SAS packages, version `20201209` #;
%put # Macro to get help about SAS packages, version `20210528` #;
%put # #;
%put # A SAS package is a zip file containing a group #;
%put # of SAS codes (macros, functions, data steps generating #;
@@ -515,7 +515,7 @@ TODO:
- add MD5(&packageName.) value hash instead "package" word in filenames [DONE]
*/
/* Macros to install SAS packages, version 20201209 */
/* Macros to install SAS packages, version 20210528 */
/* A SAS package is a zip file containing a group of files
with SAS code (macros, functions, data steps generating
data, etc.) wrapped up together and %INCLUDEed by
@@ -527,11 +527,14 @@ TODO:
packagesNames /* space separated list of packages names, without the zip extension */
, sourcePath = /* location of the package, e.g. "www.some.page/", mind the "/" at the end */
, replace = 1 /* 1 = replace if the package already exist, 0 = otherwise */
, URLuser = /* user name for the password protected URLs */
, URLpass = /* password for the password protected URLs */
, URLoptions = /* options for the `sourcePath` URLs */
)
/secure
minoperator
/*** HELP END ***/
des = 'Macro to install SAS package, version 20201209. Run %%installPackage() for help info.'
des = 'Macro to install SAS package, version 20210528. Run %%installPackage() for help info.'
;
%if (%superq(packagesNames) = ) OR (%qupcase(&packagesNames.) = HELP) %then
%do;
@@ -546,7 +549,7 @@ des = 'Macro to install SAS package, version 20201209. Run %%installPackage() fo
%put ### This is short help information for the `installPackage` macro #;
%put #--------------------------------------------------------------------------------------------#;;
%put # #;
%put # Macro to install SAS packages, version `20201209` #;
%put # Macro to install SAS packages, version `20210528` #;
%put # #;
%put # A SAS package is a zip file containing a group #;
%put # of SAS codes (macros, functions, data steps generating #;
@@ -578,6 +581,13 @@ des = 'Macro to install SAS package, version 20201209. Run %%installPackage() fo
%put # - `replace=` With default value of `1` it causes existing package file #;
%put # to be replaceed by new downloaded file. #;
%put # #;
%put # - `URLuser=` A user name for the password protected URLs, no quotes needed. #;
%put # #;
%put # - `URLpass=` A password for the password protected URLs, no quotes needed. #;
%put # #;
%put # - `URLoptions=` Options for the `sourcePath` URLs filename. Consult the SAS #;
%put # documentation for the further details. #;
%put # #;
%put #--------------------------------------------------------------------------------------------#;
%put # #;
%put # Visit: `https://github.com/yabwon/SAS_PACKAGES/tree/main/SPF/Documentation` #;
@@ -655,7 +665,14 @@ des = 'Macro to install SAS package, version 20201209. Run %%installPackage() fo
%end;
%else
%do;
filename &in URL "&sourcePath.%lowcase(&packageName.).zip" recfm=N lrecl=1;
filename &in URL "&sourcePath.%lowcase(&packageName.).zip"
%if (%superq(URLuser) ne ) %then
%do;
user = "&URLuser."
pass = "&URLuser."
%end;
&URLoptions.
recfm=N lrecl=1;
filename &out "%sysfunc(pathname(packages))/%lowcase(&packageName.).zip" recfm=N lrecl=1;
%end;
/*
@@ -842,7 +859,7 @@ des = 'Macro to install SAS package, version 20201209. Run %%installPackage() fo
/* Macro to list SAS packages in packages folder.
Version 20201209
Version 20210528
A SAS package is a zip file containing a group
of SAS codes (macros, functions, data steps generating
@@ -862,7 +879,7 @@ des = 'Macro to install SAS package, version 20201209. Run %%installPackage() fo
%macro listPackages()/PARMBUFF
des = 'Macro to list SAS packages from `packages` fileref, type %listPackages(HELP) for help, version 20201209.'
des = 'Macro to list SAS packages from `packages` fileref, type %listPackages(HELP) for help, version 20210528.'
;
%if %QUPCASE(&SYSPBUFF.) = %str(%(HELP%)) %then
%do;
@@ -877,7 +894,7 @@ des = 'Macro to list SAS packages from `packages` fileref, type %listPackages(HE
%put ### This is short help information for the `listPackages` macro #;
%put #-----------------------------------------------------------------------------------------#;;
%put # #;
%put # Macro to list available SAS packages, version `20201209` #;
%put # Macro to list available SAS packages, version `20210528` #;
%put # #;
%put # A SAS package is a zip file containing a group #;
%put # of SAS codes (macros, functions, data steps generating #;
@@ -1008,7 +1025,7 @@ options ls = &ls_tmp. ps = &ps_tmp. &notes_tmp. &source_tmp.;
/* Macro to generate SAS packages.
Version 20201209
Version 20210528
A SAS package is a zip file containing a group
of SAS codes (macros, functions, data steps generating
@@ -1040,7 +1057,7 @@ options ls = &ls_tmp. ps = &ps_tmp. &notes_tmp. &source_tmp.;
if set to DEF then the !SASROOT/sasv9.cfg is used */
)/secure minoperator
/*** HELP END ***/
des = 'Macro to generate SAS packages, version 20201209. Run %generatePackage() for help info.'
des = 'Macro to generate SAS packages, version 20210528. Run %generatePackage() for help info.'
;
%if (%superq(filesLocation) = ) OR (%qupcase(&filesLocation.) = HELP) %then
%do;
@@ -1055,7 +1072,7 @@ des = 'Macro to generate SAS packages, version 20201209. Run %generatePackage()
%put ### This is short help information for the `generatePackage` macro #;
%put #-------------------------------------------------------------------------------#;
%put # #;
%put # Macro to generate SAS packages, version `20201209` #;
%put # Macro to generate SAS packages, version `20210528` #;
%put # #;
%put # A SAS package is a zip file containing a group #;
%put # of SAS codes (macros, functions, data steps generating #;
@@ -1428,7 +1445,14 @@ data &filesWithCodes.;
_abort_ + 1;
end;
fileshort = substr(file, 1, length(file) - 4); /* filename.sas -> filename */
output;
if strip(reverse(file)) in: ('sas.') then output; /* ignore not ".sas" files */
else
do;
put "WARNING: Only *.sas files are supported." /
"WARNING- The file: " file "will be ignored." /
"WARNING- ";
end;
end;
rc = dclose(fileId);
rc = filename(fileRef);
@@ -1466,14 +1490,14 @@ title6 "MD5 hashed fileref of package lowcase name: &_PackageFileref_.";
%end;
proc print data = &filesWithCodes.(drop=base);
proc print data = &filesWithCodes.(drop=base folderRef fileRef rc folderid _abort_ fileId);
run;
title;
/* packages description */
data _null_;
infile &_DESCR_.;
file &zipReferrence.(description.sas);
file &zipReferrence.(description.sas) encoding = &packageEncoding.;
input;
put _INFILE_;
run;
@@ -1483,7 +1507,7 @@ run;
%do;
data _null_;
infile &_LIC_.;
file &zipReferrence.(license.sas);
file &zipReferrence.(license.sas) encoding = &packageEncoding.;
input;
put _INFILE_;
run;
@@ -1493,7 +1517,7 @@ run;
%put WARNING:[License] No license.sas file provided, default (MIT) licence file will be generated.;
%let packageLicense = MIT;
data _null_;
file &zipReferrence.(license.sas);
file &zipReferrence.(license.sas) encoding = &packageEncoding.;
put " ";
put " Copyright (c) %sysfunc(today(),year4.) &packageAuthor. ";
put " ";
@@ -1526,7 +1550,7 @@ data _null_;
putlog "WARNING:[&sysmacroname.] No files to create package.";
stop;
end;
file &zipReferrence.(packagemetadata.sas);
file &zipReferrence.(packagemetadata.sas) encoding = &packageEncoding.;
put ' data _null_; '; /* simple "%local" returns error while loading package */
put ' call symputX("packageName", " ", "L");';
@@ -1565,7 +1589,7 @@ run;
*/
data _null_;
file &zipReferrence.(iceloadpackage.sas);
file &zipReferrence.(iceloadpackage.sas) encoding = &packageEncoding.;
put " ";
put ' /* Temporary replacement of loadPackage() macro. */ ';
put ' %macro ICEloadPackage( ';
@@ -1617,7 +1641,7 @@ run;
data _null_;
if NOBS = 0 then stop;
file &zipReferrence.(load.sas) lrecl=32767;
file &zipReferrence.(load.sas) lrecl=32767 encoding = &packageEncoding.;
put "filename &_PackageFileref_. list;" /;
put ' %put NOTE- ;';
@@ -1734,7 +1758,7 @@ data _null_;
put ' vers = input(compress(scan(req,-1, "("), ".", "KD"),best32.); ';
put ' _RC_ = LP.add(); ';
put ' end; ';
/* check if elements of the framewor are available */
/* check if elements of the framework are available */
put ' LoadPackageExist = input(resolve(''%SYSMACEXIST( loadPackage)''), best.); ';
put ' ICELoadPackageExist = input(resolve(''%SYSMACEXIST(ICEloadPackage)''), best.); ';
@@ -1832,14 +1856,18 @@ data _null_;
*/
/* test for supported types */
if not (upcase(type) in:
('LIBNAME' 'MACRO' 'DATA' 'FUNCTION' /*'FUNCTIONS'*/ 'FORMAT' 'IMLMODULE' 'PROTO' 'EXEC' 'CLEAN' 'LAZYDATA' 'TEST'))
('LIBNAME' 'MACRO' /*'MACROS'*/ 'DATA' 'FUNCTION' /*'FUNCTIONS'*/ 'FORMAT' /*'FORMATS'*/ 'IMLMODULE' 'PROTO' 'EXEC' 'CLEAN' 'LAZYDATA' 'TEST'))
then
do;
putlog 'WARNING: Type ' type 'is not yet supported.';
continue;
end;
put '%put NOTE- ;';
put '%put NOTE- Element of type ' type 'from the file "' file +(-1) '" will be included;' /;
put '%put NOTE: Element of type ' type 'from the file "' file +(-1) '" will be included;';
if upcase(type)=:'MACRO' then
put '%put %sysfunc(ifc(%SYSMACEXIST(' fileshort ')=1, NOTE# Macro ' fileshort
"exist. It will be overwritten by the macro from the &packageName. package, ));";
put " ";
if upcase(type)=:'EXEC' then
do;
@@ -1858,23 +1886,27 @@ data _null_;
/* HEADERS for IML, FCMP, and PROTO */
if 1 = FIRST.type and upcase(type)='FUNCTIONS' then /* header, for multiple functions in one FCMP run */
do;
put "proc fcmp outlib = work.%lowcase(&packageName.fcmp).package; ";
put "proc fcmp outlib = work.%lowcase(&packageName.fcmp).package ; ";
end;
if 1 = FIRST.type and upcase(type)='PROTO' then /* header, for multiple functions in one FCMP run */
if 1 = FIRST.type and upcase(type)='PROTO' then /* header, for multiple functions in one PROTO run */
do;
put "proc proto package = work.%lowcase(&packageName.proto).package; ";
put "proc proto package = work.%lowcase(&packageName.proto).package ; ";
end;
if 1 = FIRST.type and upcase(type)='IMLMODULE' then /* header, for IML modules */
do;
put "proc iml; ";
put "proc iml ; ";
end;
if 1 = FIRST.type and upcase(type)='FORMATS' then /* header, for FORMATS */
do;
put "proc format lib = work.%lowcase(&packageName.format) ; ";
end;
/* include the file with the code of the element */
put '%include' " &_PackageFileref_.(_" folder +(-1) "." file +(-1) ') / nosource2;' /;
/* FOOTERS for IML, FCMP, and PROTO */
if 1 = LAST.type and upcase(type)='FUNCTIONS' then /* footer, for multiple functions in one FCMP run */
do;
if 1 = LAST.type and upcase(type) in ('FUNCTIONS' 'PROTO' 'FORMATS') then
do; /* footer, for multiple functions in one FCMP run, one PROTO run, or one FORMAT run */
put "run; ";
end;
if 1 = LAST.type and upcase(type)='IMLMODULE' then /* footer, for IML modules */
@@ -1883,11 +1915,6 @@ data _null_;
put "store module = _ALL_; "; /* and store all created modules */
put "quit; ";
end;
if 1 = LAST.type and upcase(type)='PROTO' then /* footer, for multiple functions in one PROTO run */
do;
put "run; ";
end;
isFunction + (upcase(type)=:'FUNCTION');
isFormat + (upcase(type)=:'FORMAT');
@@ -1966,7 +1993,7 @@ run;
data _null_;
if NOBS = 0 then stop;
file &zipReferrence.(lazydata.sas) lrecl=32767;
file &zipReferrence.(lazydata.sas) lrecl=32767 encoding = &packageEncoding.;
put "filename &_PackageFileref_. list;" /;
put ' %put NOTE- ;';
@@ -2021,7 +2048,7 @@ data _null_;
/* break if no data */
if NOBS = 0 then stop;
file &zipReferrence.(unload.sas);
file &zipReferrence.(unload.sas) encoding = &packageEncoding.;
put "filename &_PackageFileref_. list;" /;
put '%put NOTE: '"Unloading package &packageName., version &packageVersion., license &packageLicense.;";
@@ -2262,7 +2289,7 @@ data _null_;
/* break if no data */
if NOBS = 0 then stop;
file &zipReferrence.(preview.sas);
file &zipReferrence.(preview.sas) encoding = &packageEncoding.;
length strX $ 32767;
put "filename &_PackageFileref_. list;" /;
@@ -2321,7 +2348,7 @@ data _null_;
when (upcase(type) =: "FUNCTION" ) fileshort2 = cats("'", fileshort, "()'" );
when (upcase(type) =: "IMLMODULE" ) fileshort2 = cats("'", fileshort, "()'" );
when (upcase(type) =: "PROTO" ) fileshort2 = cats("'", fileshort, "()'" );
when (upcase(type) = "FORMAT" ) fileshort2 = cats("'$", fileshort, ".'" );
when (upcase(type) =: "FORMAT" ) fileshort2 = cats("'$", fileshort, ".'" );
otherwise fileshort2 = fileshort;
end;
strX = catx('/', folder, order, type, file, fileshort, fileshort2);
@@ -2373,7 +2400,7 @@ data _null_;
/* break if no data */
if NOBS = 0 then stop;
file &zipReferrence.(help.sas);
file &zipReferrence.(help.sas) encoding = &packageEncoding.;
length strX $ 32767;
put "filename &_PackageFileref_. list;" /;
@@ -2439,7 +2466,7 @@ data _null_;
put ' end ; ';
%end;
put 'put "***"; put "* SAS package generated by generatePackage, version 20201209 *"; put "***";';
put 'put "***"; put "* SAS package generated by generatePackage, version 20210528 *"; put "***";';
put 'run; ' /;
@@ -2481,7 +2508,7 @@ data _null_;
when (upcase(type) =: "FUNCTION" ) fileshort2 = cats("'", fileshort, "()'" );
when (upcase(type) =: "IMLMODULE" ) fileshort2 = cats("'", fileshort, "()'" );
when (upcase(type) =: "PROTO" ) fileshort2 = cats("'", fileshort, "()'" );
when (upcase(type) = "FORMAT" ) fileshort2 = cats("'$", fileshort, ".'" );
when (upcase(type) =: "FORMAT" ) fileshort2 = cats("'$", fileshort, ".'" );
otherwise fileshort2 = fileshort;
end;
strX = catx('/', folder, order, type, file, fileshort, fileshort2);
@@ -2510,11 +2537,13 @@ data _null_;
put ' call execute(" printer = 0; ");';
put ' call execute(" do until(EOF); ");';
put ' call execute(" input; ");';
put ' call execute(" if upcase(strip(_infile_)) ';
put ' = ''/*** HELP END ***/'' then printer = 0; ");';
put ' call execute(" _endhelpline_ = upcase(reverse(strip(_infile_))); ");';
put ' call execute(" if 18 <= lengthn(_endhelpline_) AND _endhelpline_ ';
put ' =: ''/*** DNE PLEH ***/'' then printer = 0; ");'; /* ends with HELP END */
put ' call execute(" if printer then put ""| "" _infile_; ");';
put ' call execute(" if upcase(strip(_infile_)) ';
put ' = ''/*** HELP START ***/'' then printer = 1; ");';
put ' call execute(" _starthelpline_ = upcase(strip(_infile_)); ");';
put ' call execute(" if 20 <= lengthn(_starthelpline_) AND _starthelpline_ ';
put ' =: ''/*** HELP START ***/'' then printer = 1; ");'; /* starts with HELP START */
put ' call execute(" end; ");';
put ' call execute(" put "" "" / "" ""; ");';
put ' call execute(" stop; ");';
@@ -2582,8 +2611,10 @@ data _null_;
call execute(' retain test .;');
call execute(' infile _SPFIN_ lrecl=32767 dlm="0a0d"x end=EOF;');
call execute(' input;');
call execute(' if upcase(strip(_infile_)) = "/*** HELP START ***/" then test + (+1); ');
call execute(' if upcase(strip(_infile_)) = "/*** HELP END ***/" then test + (-1); ');
call execute(' _starthelpline_ = upcase(strip(_infile_));');
call execute(' if 20 <= lengthn(_starthelpline_) AND _starthelpline_ =: "/*** HELP START ***/" then test + (+1); ');
call execute(' _endhelpline_ = upcase(reverse(strip(_infile_)));');
call execute(' if 18 <= lengthn(_endhelpline_) AND _endhelpline_ =: "/*** DNE PLEH ***/" then test + (-1); '); /* *** HELP END *** */
call execute(' if (test not in (.,0,1)) or (EOF and test) then ');
call execute(' do; ');
call execute(' put "ERROR: Unmatched or nested HELP tags in ' !! catx('/', folder, file) !! '! Line: " _N_; ');
@@ -2632,15 +2663,59 @@ filename &zipReferrence. clear;
/* tests of package are executed by default */
%if %bquote(&testPackage.) ne Y %then
%if %bquote(&testPackage.) ne Y %then
%do;
%put WARNING: ** NO TESTING WILL BE EXECUTED. **;
%GOTO NOTESTING;
%end;
/* check if systask is available */
%if %sysfunc(GETOPTION(XCMD)) = NOXCMD %then
%if %sysfunc(GETOPTION(XCMD)) = NOXCMD %then
%do;
%put WARNING: ** NO TESTING WILL BE EXECUTED DUE TO NOXCMD. **;
data _null_;
put 'WARNING: NO TESTING WILL BE EXECUTED DUE TO NOXCMD.';
put '***************************************************';
put ;
put 'NOTE-To execute the loading test manualy';
put 'NOTE-run the following code:';
put 'NOTE-';
n=6;
put @n "filename packages '&packages.';" /;
if fileexist("&packages./SPFinit.sas") then
put @n '%include packages(SPFinit.sas);' /;
else if fileexist("&packages./loadpackage.sas") then
put @n '%include packages(loadpackage.sas);' / ; /* for older versions when the SPFinit.sas did not exist */
/* load */
put @n '%loadpackage'"(&packageName.,";
put @n " path=&filesLocation.)" /;
put @n '%loadpackage'"(&packageName.,";
put @n " path=&filesLocation., lazyData=*)" /;
/* help */
put @n '%helpPackage'"(&packageName.,";
put @n " path=&filesLocation.)" /;
put @n '%helpPackage'"(&packageName.,*,";
put @n " path=&filesLocation.)" /;
put @n '%helpPackage'"(&packageName.,License,";
put @n " path=&filesLocation.)" /;
/* preview */
put @n '%previewPackage'"(&packageName.,";
put @n " path=&filesLocation.)" /;
put @n '%previewPackage'"(&packageName.,*,";
put @n " path=&filesLocation.)" /;
/* unload */
put @n '%unloadPackage'"(&packageName.,";
put @n " path=&filesLocation.) " /;
put ;
put '***************************************************';
run;
%GOTO NOTESTING;
%end;
@@ -2664,7 +2739,7 @@ filename &zipReferrence. clear;
%let SASROOT=%sysfunc(PATHNAME(sasroot));
filename sasroot;
%put *&SASROOT.*;
%let SASEXE=&SASROOT./sas;
%let SASEXE=&SASROOT./sas;
%end;
%else
%do;
@@ -2723,7 +2798,7 @@ filename &zipReferrence. clear;
options DLCREATEDIR; /* turns-on creation of subdirectories by libname */
/* temporary location for tests results is WORK unless developer provide &testResults. */
%local testPackageTimesamp;
%local testPackageTimesamp;
%let testPackageTimesamp = %lowcase(&packageName._%sysfunc(datetime(),b8601dt15.));
%if %qsysfunc(fileexist(%bquote(&testResults.))) %then
%do;
@@ -2738,7 +2813,7 @@ libname TESTWORK "&SASWORK./testwork_&testPackageTimesamp.";
%local dirForTest dirForTestWork;
%let dirForTest = %sysfunc(pathname(TEST));
%let dirForTestWork = %sysfunc(pathname(TESTWORK));
%put &=dirForTest.;
%put &=dirForTest.;
%put &=dirForTestWork.;
/* remember location of sessions current directory */
@@ -2772,6 +2847,10 @@ options NOquotelenmax;
data _null_;
file "./loading.sas";
put "proc printto";
put "log = '&dirForTest./loading.log0'";
put "; run;";
put "filename packages '&packages.';" /;
if fileexist("&packages./SPFinit.sas") then
@@ -2799,9 +2878,57 @@ data _null_;
put '%previewPackage'"(&packageName.,*,";
put " path=&filesLocation.)" /;
/*check if package elements realy exists*/
EOF = 0;
do until(EOF);
set &filesWithCodes. end = EOF;
by type notsorted;
fileshortUP = UPCASE(fileshort); drop fileshortUP;
select;
when (upcase(type) in ("LAZYDATA")) /* the "DATA" type will pop-up during deletion */
do;
if 1 = FIRST.type then
put "data _null_; " ;
put " if not exist('" fileshortUP "') then " /
" put 'WARNING: Dataset " fileshortUP "does not exist!'; "
;
if 1 = LAST.type then
put "run; ";
end;
when (upcase(type) =: "MACRO")
do;
if 1 = FIRST.type then
put "data _null_; " ;
put ' if not input(resolve(''%SYSMACEXIST(' fileshortUP ')''), best.) then ' /
" put 'WARNING: Macro " fileshortUP "does not exist!'; "
;
if 1 = LAST.type then
put "run; ";
end;
/* the "FUNCTION" type will pop-up during deletion */
/* figure out checks for remaining list: */
/*
"IMLMODULE"
"PROTO"
"FORMAT"
*/
otherwise;
end;
end;
/* unload */
put '%unloadPackage'"(&packageName.,";
put " path=&filesLocation.) " /;
put "proc printto";
put "; run;";
stop;
run;
/*
@@ -2813,46 +2940,55 @@ setup for testing session:
-work - location for work
-noterminal - for batch execution mode
-rsasuser - to avoid the "Unable to copy SASUSER registry to WORK registry." warning
-linesize - MAX
-linesize - MAX
-pagesize - MAX
*/
systask kill sas0 wait;
%local sasstat0 TEST_0 TESTRC_0;;
%let TEST_0 = loading;
systask command
"""&SASEXE.""
-sysin ""&dirForTest./&TEST_0..sas""
-print ""&dirForTest./&TEST_0..lst""
-log ""&dirForTest./&TEST_0..log""
%local STSK;
%let STSK = systask command
%str(%')"&SASEXE."
-sysin "&dirForTest./&TEST_0..sas"
-print "&dirForTest./&TEST_0..lst"
-log "&dirForTest./&TEST_0..log"
/*-altlog "&dirForTest./&TEST_0..altlog"*/
&SASCONFIG.
-work ""&dirForTestWork.""
-work "&dirForTestWork."
-noterminal
-rsasuser -linesize MAX -pagesize MAX"
-rsasuser -linesize MAX -pagesize MAX -noautoexec %str(%')
taskname=sas0
status=sasstat0
WAIT
;
%put %superq(STSK);
;
%unquote(&STSK.);
;
%let TESTRC_0 = &SYSRC.;
%put *&=sasstat0.*&=TESTRC_0.*;
%local notesSourceOptions;
%let notesSourceOptions = %sysfunc(getoption(notes)) %sysfunc(getoption(source));
options NOnotes NOsource;
data _null_;
if _N_ = 1 then
if _N_ = 1 then
put "##########################################################################" /
"./loading.log" /
"./loading.log0" /
"##########################################################################" ;
infile "./loading.log" dlm='0a0d'x end=EOF;
infile "./loading.log0" dlm='0a0d'x end=EOF;
input;
if _INFILE_ =: 'WARNING:' then
if _INFILE_ =: 'WARNING:' then
do;
warning+1;
warning+1;
put _N_= "**" _INFILE_;
end;
if _INFILE_ =: 'ERROR:' then
if _INFILE_ =: 'ERROR:' then
do;
error+1;
put _N_= "$$" _INFILE_;
put _N_= "$$" _INFILE_;
end;
if EOF then
do;
@@ -2882,14 +3018,17 @@ data _null_;
_RC_ = filename(cats("_TOUT_",test), cats("./", file));
_RC_ = fcopy(cats("_TIN_",test), cats("_TOUT_", test));
call symputX(cats("TEST_", test), fileshort, "L");
call symputX("numberOfTests", test, "L");
_RC_ = filename(cats("_TIN_",test));
_RC_ = filename(cats("_TOUT_",test));
run;
%local t;
%do t = 1 %to &numberOfTests.;
/* each test is executed with autoexec loading the package */
data _null_;
/* break if no data */
@@ -2897,6 +3036,10 @@ data _null_;
file "./autoexec.sas";
put "proc printto";
put "log = '&dirForTest./&&TEST_&t...log0'";
put "; run;";
put "filename packages '&packages.';" /;
if fileexist("&packages./SPFinit.sas") then
@@ -2909,52 +3052,63 @@ data _null_;
put '%loadpackage'"(&packageName.,";
put " path=&filesLocation., lazyData=*)" /;
/*
put "proc printto";
put "; run;";
*/
stop;
set &filesWithCodes. nobs = NOBS;
run;
%local t;
%do t = 1 %to &numberOfTests.;
systask kill sas&t. wait;
%local sasstat&t. TESTRC_&t;
%let STSK =
systask command
"""&SASEXE.""
-sysin ""&dirForTest./&&TEST_&t...sas""
-print ""&dirForTest./&&TEST_&t...lst""
-log ""&dirForTest./&&TEST_&t...log""
%str(%')"&SASEXE."
-sysin "&dirForTest./&&TEST_&t...sas"
-print "&dirForTest./&&TEST_&t...lst"
-log "&dirForTest./&&TEST_&t...log"
/*-altlog "&dirForTest./&&TEST_&t...altlog"*/
&SASCONFIG.
-work ""&dirForTestWork.""
-autoexec ""&dirForTest./autoexec.sas""
-work "&dirForTestWork."
-autoexec "&dirForTest./autoexec.sas"
-noterminal
-rsasuser"
-rsasuser %str(%')
taskname=sas&t.
status=sasstat&t.
WAIT
;
%put %superq(STSK);
;
%unquote(&STSK.);
;
%let TESTRC_&t = &SYSRC.;
%put *sasstat&t.=&&sasstat&t.*TESTRC_&t=&&TESTRC_&t*;
%local notesSourceOptions;
%let notesSourceOptions = %sysfunc(getoption(notes)) %sysfunc(getoption(source));
options NOnotes NOsource;
data _null_;
if _N_ = 1 then
if _N_ = 1 then
put "##########################################################################" /
"./&&TEST_&t...log" /
"./&&TEST_&t...log0" /
"##########################################################################" ;
infile "./&&TEST_&t...log" dlm='0a0d'x end=EOF;
infile "./&&TEST_&t...log0" dlm='0a0d'x end=EOF;
input;
if _INFILE_ =: 'WARNING:' then
if _INFILE_ =: 'WARNING:' then
do;
warning+1;
warning+1;
/*length warningline $ 1024;
warningline = catx(',', strip(warningline), _N_);*/
put _N_= "**" _INFILE_;
end;
if _INFILE_ =: 'ERROR:' then
if _INFILE_ =: 'ERROR:' then
do;
error+1;
/*length errorline $ 1024;
errorline = catx(',', strip(errorline), _N_);*/
errorline = catx(',', strip(errorline), _N_);*/
put _N_= "$$" _INFILE_;
end;
if EOF then
@@ -3026,7 +3180,7 @@ TODO: (in Polish)
- dodac typ "proto" [v]
- lista wymaganych komponentow potrzebnych do działania SASa (na bazie proc SETINIT) [v]
- lista wymaganych komponentow potrzebnych do dzialania SASa (na bazie proc SETINIT) [v]
- sparwdzanie domknietosci, parzystosci i wystepowania tagow HELP START - HELP END w plikach [v]
@@ -3036,7 +3190,7 @@ TODO: (in Polish)
- dodac ICEloadPackage() [v]
- weryfikacja nadpisywania makr [ ]
- weryfikacja nadpisywania makr [v]
- weryfikacja srodowiska [ ]
@@ -3082,7 +3236,7 @@ TODO: (in Polish)
*/
)/secure
/*** HELP END ***/
des = 'Macro to load multiple SAS packages at one run, version 20201209. Run %loadPackages() for help info.'
des = 'Macro to load multiple SAS packages at one run, version 20210528. Run %loadPackages() for help info.'
parmbuff
;
%if (%superq(packagesNames) = ) OR (%qupcase(&packagesNames.) = HELP) %then
@@ -3098,7 +3252,7 @@ parmbuff
%put ### This is short help information for the `loadPackageS` macro #;
%put #-------------------------------------------------------------------------------#;
%put # #;
%put # Macro wrapper for the loadPackage macro, version `20201209` #;
%put # Macro wrapper for the loadPackage macro, version `20210528` #;
%put # #;
%put # A SAS package is a zip file containing a group #;
%put # of SAS codes (macros, functions, data steps generating #;
@@ -3182,7 +3336,7 @@ parmbuff
hashing_file() function, SAS 9.4M6 */
)/secure
/*** HELP END ***/
des = 'Macro to verify SAS package with the hash digest, version 20201209. Run %verifyPackage() for help info.'
des = 'Macro to verify SAS package with the hash digest, version 20210528. Run %verifyPackage() for help info.'
;
%if (%superq(packageName) = ) OR (%qupcase(&packageName.) = HELP) %then
%do;
@@ -3197,7 +3351,7 @@ des = 'Macro to verify SAS package with the hash digest, version 20201209. Run %
%put ### This is short help information for the `verifyPackage` macro #;
%put #-------------------------------------------------------------------------------#;
%put # #;
%put # Macro to verify SAS package with it hash digest, version `20201209` #;
%put # Macro to verify SAS package with it hash digest, version `20210528` #;
%put # #;
%put # A SAS package is a zip file containing a group #;
%put # of SAS codes (macros, functions, data steps generating #;
@@ -3243,7 +3397,7 @@ des = 'Macro to verify SAS package with the hash digest, version 20201209. Run %
%put %nrstr( %%include packages(SPFinit.sas); %%* enable the framework; );
%put ;
%put %nrstr( %%installPackage(SQLinDS) %%* install the package from the Internet; );
%put %nrstr( %%verifPackage%(SQLinDS, %%* verify the package with provided hash; );
%put %nrstr( %%verifyPackage%(SQLinDS, %%* verify the package with provided hash; );
%put %nrstr( hash=HDA478ANJ3HKHRY327FGE88HF89VH89HFFFV73GCV98RF390VB4%) );
%put ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~;
%put #################################################################################;
@@ -3350,7 +3504,7 @@ des = 'Macro to verify SAS package with the hash digest, version 20201209. Run %
*/
)/secure
/*** HELP END ***/
des = 'Macro to preview content of a SAS package, version 20201209. Run %previewPackage() for help info.'
des = 'Macro to preview content of a SAS package, version 20210528. Run %previewPackage() for help info.'
;
%if (%superq(packageName) = ) OR (%qupcase(&packageName.) = HELP) %then
%do;
@@ -3365,7 +3519,7 @@ des = 'Macro to preview content of a SAS package, version 20201209. Run %preview
%put ### This is short help information for the `previewPackage` macro #;
%put #-------------------------------------------------------------------------------#;
%put # #;
%put # Macro to get previwe of a SAS packages, version `20201209` #;
%put # Macro to get previwe of a SAS packages, version `20210528` #;
%put # #;
%put # A SAS package is a zip file containing a group #;
%put # of SAS codes (macros, functions, data steps generating #;
@@ -3425,7 +3579,7 @@ des = 'Macro to preview content of a SAS package, version 20201209. Run %preview
%put %nrstr( %%include packages(SPFinit.sas); %%* enable the framework; );
%put ;
%put %nrstr( %%installPackage(SQLinDS) %%* install the package from the Internet; );
%put %nrstr( %%previewpPackage(SQLinDS) %%* get content of the package; );
%put %nrstr( %%previewPackage(SQLinDS) %%* get content of the package; );
%put ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~;
%put #################################################################################;
%put ;

View File

@@ -1,4 +1,4 @@
Copyright (c) 2019 - 2020 Bartosz Jablonski
Copyright (c) 2019 - 2021 Bartosz Jablonski
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal

View File

@@ -7,7 +7,7 @@ Currently the following packages are available:
---
- **SQLinDS**\[2.2\], based on Mike Rhoads' article *Use the Full Power of SAS in Your Function-Style Macros*. The package allows to write SQL queries in the data step, e.g.
```
```sas
data class;
set %SQL(
select age, name, weight, height
@@ -18,7 +18,7 @@ data class;
WH = weight + height;
run;
```
SHA256 digest for SQLinDS: CE1A266B9030E5E336B45F53DF483F6913FD8AE88A2884CEE88BEEF621FDBD78
SHA256 digest for SQLinDS: 1853CD6262CF66582A33C373AA612CA714B61CB88A1C51745E7A57D5A03C39B4
[Documentation for SQLinDS](https://github.com/yabwon/SAS_PACKAGES/blob/main/packages/sqlinds.md "Documentation for SQLinDS")
@@ -32,8 +32,8 @@ SHA256 digest for MacroCore: A23C29529F3CE7D0C8BEE9545C5D22D5B5594907547374A5135
---
- **DFA** (Dynamic Function Arrays)\[0.3\], contains set of macros and FCMP functions which implement: a dynamically allocated array, a stack, a fifo queue, an ordered stack, and a priority queue, run `%helpPackage(DFA,createDFArray)` to find examples.
```
- **DFA** (Dynamic Function Arrays)\[0.5\], contains set of macros and FCMP functions which implement: a dynamically allocated array, a stack, a fifo queue, an ordered stack, and a priority queue, run `%helpPackage(DFA,createDFArray)` to find examples.
```sas
%createDFArray(ArrDynamic, resizefactor=17);
data _null_;
@@ -59,14 +59,14 @@ data _null_;
end;
run;
```
SHA256 digest for DFA: 1FC8D030D576C33F1B5DEB27E17534946209BC148D57A1357CA025ED1E69AEB8
SHA256 digest for DFA: 22AB51B85E3344B8C0FB7AF164247881B656F5CBA88BBA974AD8BC41ED79327F
[Documentation for DFA](https://github.com/yabwon/SAS_PACKAGES/blob/main/packages/dfa.md "Documentation for DFA")
---
- **macroArray**\[0.8\], implementation of an array concept in a macro language, e.g.
```
```sas
%array(ABC[17] (111:127), macarray=Y);
%macro test();
@@ -84,14 +84,14 @@ SHA256 digest for DFA: 1FC8D030D576C33F1B5DEB27E17534946209BC148D57A1357CA025ED1
which = 1:H:2
);
```
SHA256 digest for macroArray: AC3AD58AFBBE459616743DC6346330BD8DD33FBA8CDD595423F181B67D0475BC
SHA256 digest for macroArray: 849629D3AF3FE3AB45D86990E303F1D5E4D5F9F31C8ED6864C95B0DFAADCA445
[Documentation for macroArray](https://github.com/yabwon/SAS_PACKAGES/blob/main/packages/macroarray.md "Documentation for macroArray")
---
- **BasePlus**\[0.991\] adds a bunch of functionalities I am missing in BASE SAS, such as:
```
```sas
call arrMissToRight(myArray);
call arrFillMiss(17, myArray);
call arrFill(42, myArray);
@@ -104,7 +104,7 @@ format x bool.;
%put %getVars(sashelp.class, pattern = ght$, sep = +, varRange = _numeric_);
```
SHA256 digest for BasePlus: 9EA40F72191D1916189F043315CA519F6E42CEB05C186F7653AE464D21D21CFB
SHA256 digest for BasePlus: A321A4BC54D444B82575EC5D443553A096557AD69DC171D578A330277E67637A
[Documentation for BasePlus](https://github.com/yabwon/SAS_PACKAGES/blob/main/packages/baseplus.md "Documentation for BasePlus")
@@ -112,6 +112,6 @@ SHA256 digest for BasePlus: 9EA40F72191D1916189F043315CA519F6E42CEB05C186F7653AE
- **dynMacroArray**\[0.2\], set of macros (wrappers for a hash table) emulating dynamic array in the data step (macro predecessor of DFA)
SHA256 digest for dynMacroArray: 5E8CCC88CC048A0B564CEE37C6CF4013857D9CFF3FA1B6B9AD6F719D08B30005
SHA256 digest for dynMacroArray: 67956116578E71327748B7EB3DAFF9D872DBC6F6EDD0DC11B7CF2A54FDA71785
---

View File

@@ -1,3 +1,23 @@
/* 20210528 */
BasePlus: A321A4BC54D444B82575EC5D443553A096557AD69DC171D578A330277E67637A
DFA: 22AB51B85E3344B8C0FB7AF164247881B656F5CBA88BBA974AD8BC41ED79327F
dynMacroArray: 67956116578E71327748B7EB3DAFF9D872DBC6F6EDD0DC11B7CF2A54FDA71785
macroArray: 849629D3AF3FE3AB45D86990E303F1D5E4D5F9F31C8ED6864C95B0DFAADCA445
SQLinDS: 1853CD6262CF66582A33C373AA612CA714B61CB88A1C51745E7A57D5A03C39B4
/* 20210117 */
DFA: 179AAB9DF3DE8F049A4EFDF5FB0BE92AE5F7BFA7708D4365F39D4DC71C4F90FE
/* 20210109 */
BasePlus: 28F3DE865C5E3B914FFB7CC2627D8B0975527EEECEE7AFEAD7B335C3FDC1BFD3
DFA: E777D4578DFDEB2277D58264BAB5BFDBEAFD4E538D4831CDCBFFB4216D2441C2
dynMacroArray: 8B0777EA3CF41968C0B029AA57B1F809D21D1BAB1B88A35B0EA5DB3C6DD9E748
macroArray: 42E87B80450B3E1AD462B9B63B41F34C83B7745AA0F98C3CA72AA19F3B1FF10E
SQLinDS: 3034A0C8AC43683AD55698861DBBDEBDE6FC8567D59ECF2BB5F3389FE6BC8062
/* 20201229 */
DFA: 5B41657A8A3BEAD185B13D072BC54902AB81FEAD32330DA8ABA90CF777D4D76E
/* 20201207 */
macroArray: AC3AD58AFBBE459616743DC6346330BD8DD33FBA8CDD595423F181B67D0475BC
BasePlus: 9EA40F72191D1916189F043315CA519F6E42CEB05C186F7653AE464D21D21CFB

View File

@@ -1,5 +1,5 @@
/*** HELP START ***/
/*
/*** HELP START ***//*
## >>> library `dsSQL`: <<< <a name="library-dssql"></a> ########################
The `dsSQL` library stores temporary views
@@ -15,8 +15,8 @@ if not possible, then redirects to the `WORK` location, like:
LIBNAME dsSQL BASE "%sysfunc(pathname(WORK))";
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
---
*/
/*** HELP END ***/
*//*** HELP END ***/
data _null_;
length rc0 $ 32767 rc1 rc2 8;

View File

@@ -1,5 +1,5 @@
/*** HELP START ***/
/*
/*** HELP START ***//*
## >>> `%dsSQL_Inner()` macro: <<< <a name="dssql-inner-macro"></a> #############
**Internal** macro called by `dsSQL()` function.
@@ -9,8 +9,8 @@ which is then stored in the `dsSQL` library.
Recommended for *SAS 9.3* and higher.
---
*/
/*** HELP END ***/
*//*** HELP END ***/
/* inner macro */
%MACRO dsSQL_Inner() / secure;

View File

@@ -1,5 +1,5 @@
/*** HELP START ***/
/*
/*** HELP START ***//*
## >>> `%SQL()` macro: <<< <a name="dssql-macro"></a> ###########################
The **main** macro which allows to use
@@ -41,8 +41,8 @@ data dictionary;
run;
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
---
*/
/*** HELP END ***/
*//*** HELP END ***/
/* Main User macro */

View File

@@ -1,5 +1,5 @@
/*** HELP START ***/
/*
/*** HELP START ***//*
## >>> `dsSQL()` function: <<< <a name="dssql-function"></a> ####################
**Internal** function called by the `%SQL()` macro.
@@ -20,8 +20,8 @@ dsSQL(unique_index_2, query)
2. `query` - *Character*, internal variable, contains query text.
---
*/
/*** HELP END ***/
*//*** HELP END ***/
proc fcmp
/*inlib = work.&packageName.fcmp*/

View File

@@ -221,10 +221,10 @@ Package contains:
40. functions quicksorthashsddv
41. functions quicksortlight
*SAS package generated by generatePackage, version 20201115*
*SAS package generated by generatePackage, version 20210109*
The SHA256 hash digest for package BasePlus:
`9EA40F72191D1916189F043315CA519F6E42CEB05C186F7653AE464D21D21CFB`
`A321A4BC54D444B82575EC5D443553A096557AD69DC171D578A330277E67637A`
---
# Content description ############################################################################################

Binary file not shown.

View File

@@ -6,6 +6,11 @@
* [`%createDHOrdStack()` macro](#createdhordstack-macro)
* [`%createDHPrtQueue()` macro](#createdhprtqueue-macro)
* [`%createDHStack()` macro](#createdhstack-macro)
* [`bit64orPROTOdfa()` proto function](#bit64orprotodfa-proto-function)
* [`bit64andPROTOdfa()` proto function](#bit64andprotodfa-proto-function)
* [`bit64orDFA()` subroutine](#bit64ordfa-function)
* [`bit64andDFA()` subroutine](#bit64anddfa-function)
* [`%createDFBitmap()` macro](#createdfbitmap-macro)
* [`generateArrays` exec](#createdhprtqueue-exec)
* [`generateArrays` clean](#createdhprtqueue-clean)
@@ -13,14 +18,15 @@
---
# The DFA package [ver. 0.3] <a name="dfa-package"></a> ###############################################
# The DFA package [ver. 0.5] <a name="dfa-package"></a> ###############################################
The **DFA** (a.k.a. *Dynamic Function Array*) package implements:
- dynamic numeric and character arrays,
- dynamic stacks (filo),
- dynamic queues (fifo),
- dynamic ordered stacks,
- priority queues.
- priority queues,
- bitmap.
The package provides a set of *macros*,
which allows to *generate* `call routines`
@@ -32,19 +38,24 @@ See particular macro help for further details.
---
Package contains:
1. macro createdfarray
2. macro createdharray
3. macro createdhfifo
4. macro createdhordstack
5. macro createdhprtqueue
6. macro createdhstack
7. exec generatearrays
8. clean generatearrays
1. macro createdfarray
2. macro createdharray
3. macro createdhfifo
4. macro createdhordstack
5. macro createdhprtqueue
6. macro createdhstack
7. proto bit64andprotodfa
8. proto bit64orprotodfa
9. functions bit64anddfa
10. functions bit64ordfa
11. macro createdfbitmap
12. exec generatearrays
13. clean generatearrays
*SAS package generated by generatePackage, version 20201115*
*SAS package generated by generatePackage, version 20210109*
The SHA256 hash digest for package BasePlus:
`1FC8D030D576C33F1B5DEB27E17534946209BC148D57A1357CA025ED1E69AEB8`
`22AB51B85E3344B8C0FB7AF164247881B656F5CBA88BBA974AD8BC41ED79327F`
---
# Content description ############################################################################################
@@ -70,6 +81,7 @@ The basic syntax is the following, the `<...>` means optional parameters:
<,resizeFactor=0>
<,outlib=work.DFAfcmp.package>
<,hashexp=13>
<,header=1>
)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
@@ -107,6 +119,10 @@ The basic syntax is the following, the `<...>` means optional parameters:
* `hashexp=` - *Optional*, the default value is `13`. It is the default `hashexp=`
value for internal hash table used by the function.
* `header=` - *Optional*, the default value is `1`. Indicates if
the `proc fcmp outlib = &outlib.;` header is added to
the executed code. If not 1 then no header is added.
**Created function arguments description**:
A function generated by the macro is:
@@ -312,6 +328,7 @@ The basic syntax is the following, the `<...>` means optional parameters:
<,type=8>
<,outlib=work.DFAfcmp.package>
<,hashexp=13>
<,header=1>
)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
@@ -340,6 +357,10 @@ The basic syntax is the following, the `<...>` means optional parameters:
* `hashexp=` - *Optional*, the default value is `13`. It is the default `hashexp=`
value for internal hash table used by the function.
* `header=` - *Optional*, the default value is `1`. Indicates if
the `proc fcmp outlib = &outlib.;` header is added to
the executed code. If not 1 then no header is added.
**Created function arguments description**:
A function generated by the macro is:
@@ -466,6 +487,7 @@ The basic syntax is the following, the `<...>` means optional parameters:
<,type=8>
<,outlib=work.DFAfcmp.package>
<,hashexp=13>
<,header=1>
)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
@@ -494,6 +516,10 @@ The basic syntax is the following, the `<...>` means optional parameters:
* `hashexp=` - *Optional*, the default value is `13`. It is the default `hashexp=`
value for internal hash table used by the function.
* `header=` - *Optional*, the default value is `1`. Indicates if
the `proc fcmp outlib = &outlib.;` header is added to
the executed code. If not 1 then no header is added.
**Created function arguments description**:
A function generated by the macro is:
@@ -637,6 +663,7 @@ The basic syntax is the following, the `<...>` means optional parameters:
<,order=A>
<,outlib=work.DFAfcmp.package>
<,hashexp=13>
<,header=1>
)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
@@ -669,7 +696,10 @@ The basic syntax is the following, the `<...>` means optional parameters:
* `hashexp=` - *Optional*, the default value is `13`. It is the default `hashexp=`
value for internal hash table used by the function.
* `header=` - *Optional*, the default value is `1`. Indicates if
the `proc fcmp outlib = &outlib.;` header is added to
the executed code. If not 1 then no header is added.
**Created function arguments description**:
A function generated by the macro is:
@@ -793,6 +823,7 @@ The basic syntax is the following, the `<...>` means optional parameters:
<,newOnTop=+>
<,outlib=work.DFAfcmp.package>
<,hashexp=13>
<,header=1>
)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
@@ -826,7 +857,10 @@ The basic syntax is the following, the `<...>` means optional parameters:
* `hashexp=` - *Optional*, the default value is `13`. It is the default `hashexp=`
value for internal hash table used by the function.
* `header=` - *Optional*, the default value is `1`. Indicates if
the `proc fcmp outlib = &outlib.;` header is added to
the executed code. If not 1 then no header is added.
**Created function arguments description**:
A function generated by the macro is:
@@ -954,6 +988,7 @@ The basic syntax is the following, the `<...>` means optional parameters:
<,type=8>
<,outlib=work.DFAfcmp.package>
<,hashexp=13>
<,header=1>
)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
@@ -982,7 +1017,10 @@ The basic syntax is the following, the `<...>` means optional parameters:
* `hashexp=` - *Optional*, the default value is `13`. It is the default `hashexp=`
value for internal hash table used by the function.
* `header=` - *Optional*, the default value is `1`. Indicates if
the `proc fcmp outlib = &outlib.;` header is added to
the executed code. If not 1 then no header is added.
**Created function arguments description**:
A function generated by the macro is:
@@ -1089,6 +1127,413 @@ The `value` argument is **outarg**, i.e. can be changed by the function.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
---
## >>> `bit64orPROTOdfa()` proto function: <<< <a name="bit64orprotodfa-proto-function"></a> #######################
The **bit64orPROTOdfa()** is external *C* function,
this is the implementation of the *bitwise OR* operation
on doubles. A double is returned.
**Caution!** For SAS numeric values *only* operations on first 53 bits are valid!
The function is used **internally** by functions in the *DFA* package.
### SYNTAX: ###################################################################
The basic syntax is the following:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
bit64orPROTOdfa(i, j)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
**Arguments description**:
1. `i` - A double numeric argument.
2. `j` - A double numeric argument.
---
## >>> `bit64andPROTOdfa()` proto function: <<< <a name="bit64andprotodfa-proto-function"></a> #######################
The **bit64andPROTOdfa()** is external *C* function,
this is the implementation of the *bitwise AND* operation
on doubles. A double is returned.
**Caution!** For SAS numeric values *only* operations on first 53 bits are valid!
The function is used **internally** by functions in the *DFA* package.
### SYNTAX: ###################################################################
The basic syntax is the following:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
bit64andPROTOdfa(i, j)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
**Arguments description**:
1. `i` - A double numeric argument.
2. `j` - A double numeric argument.
---
## >>> `bit64orDFA()` subroutine: <<< <a name="bit64ordfa-function"></a> #######################
The **bit64orDFA()** function is an alternative to
the 32 bit bitwise `BOR()` function working on SAS numerics.
Allows to work on *up to* 53 bits of SAS numeric value.
The `bit64orDFA()` is an *internal* function of the `DFA` package.
### SYNTAX: ###################################################################
The basic syntax is the following, the `<...>` means optional parameters:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
bit64orDFA(a, b)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
**Arguments description**:
1. `a` - Argument is a SAS numeric values.
2. `B` - Argument is a SAS numeric values.
### EXAMPLES AND USECASES: ####################################################
**EXAMPLE 1.** Basic test of `bit64orDFA()` and `bit64andDFA()`
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
options ls = max ps = max;
%let M = 53 ; %* 53 is maximum valid value;
data _null_;
array bitmask [ 0: &M] _temporary_ ;
do P = 1 to &M ;
bitmask[P] = 2**(P-1) ;
put bitmask[P] = binary54. @;
put bitmask[P] = best32.;
end ;
bitmask[0] = bitmask[&M.] ;
put bitmask[0] = best32. /;
a=0;
put a = binary54.;
do P = 1 to &M ;
a = BIT64ORDFA (a, bitmask[P]) ;
put a = binary54.;
end;
put;
b = 0;
put b = binary54./;
do P = 1 to &M ;
b + (BIT64ANDDFA (a, bitmask[P]) ne .) ;
put b = best32.;
end;
run;
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
---
## >>> `bit64andDFA()` subroutine: <<< <a name="bit64anddfa-function"></a> #######################
The **bit64andDFA()** function is an alternative to
the 32 bit bitwise `BAND()` function working on SAS numerics.
Allows to work on *up to* 53 bits of SAS numeric value.
The `bit64andDFA()` is an *internal* function of the `DFA` package.
### SYNTAX: ###################################################################
The basic syntax is the following, the `<...>` means optional parameters:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
bit64andDFA(a, b)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
**Arguments description**:
1. `a` - Argument is a SAS numeric values.
2. `B` - Argument is a SAS numeric values.
### EXAMPLES AND USECASES: ####################################################
**EXAMPLE 1.** Basic test of `bit64orDFA()` and `bit64andDFA()`
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
options ls = max ps = max;
%let M = 53 ; %* 53 is maximum valid value;
data _null_;
array bitmask [ 0: &M] _temporary_ ;
do P = 1 to &M ;
bitmask[P] = 2**(P-1) ;
put bitmask[P] = binary54. @;
put bitmask[P] = best32.;
end ;
bitmask[0] = bitmask[&M.] ;
put bitmask[0] = best32. /;
a=0;
put a = binary54.;
do P = 1 to &M ;
a = BIT64ORDFA (a, bitmask[P]) ;
put a = binary54.;
end;
put;
b = 0;
put b = binary54./;
do P = 1 to &M ;
b + (BIT64ANDDFA (a, bitmask[P]) ne .) ;
put b = best32.;
end;
run;
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
---
## >>> `%createDFBitmap()` macro: <<< <a name="createdfbitmap-macro"></a> #######################
The `%createDFBitmap()` macro allows to generate
a `dynamic function bitmap` which is a FCMP based
approach to create *dynamically* allocated **numeric**
bitmnap.
*Note:* Arrays provided by the macro are *one dimensional* arrays.
The idea of a SAS bitmap is based on:
1. SGF Paper 3101-2019
titeled **Re-Mapping A Bitmap** by *Paul M. Dorfman* and *Lessia S. Shajenko*
[https://www.sas.com/content/dam/SAS/support/en/sas-global-forum-proceedings/2019/3101-2019.pdf](https://www.sas.com/content/dam/SAS/support/en/sas-global-forum-proceedings/2019/3101-2019.pdf)
2. SUGI Paper 8-26
titeled **Table Look-Up by Direct Addressing: Key-Indexing -- Bitmapping -- Hashing** by *Paul M. Dorfman*
[https://support.sas.com/resources/papers/proceedings/proceedings/sugi26/p008-26.pdf](https://support.sas.com/resources/papers/proceedings/proceedings/sugi26/p008-26.pdf)
### SYNTAX: ###################################################################
The basic syntax is the following, the `<...>` means optional parameters:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
%createDFBitmap(
bitmapName
<,debug=0>
<,outlib=work.DFAfcmp.package>
<,type=32>
<,header=1>
)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
**Arguments description**:
1. `bitmapName` - *Required*, creates a FCMP call subroutine which is also
a bitmap name. In the data step it is used in form of
a call subroutine, e.g. `call bitmapName("Allocate", 3000)`.
Has to satisfy FCMP function naming requirements, but with
maximum of 24 characters.
* `debug=` - *Optional*, the default value is `0`.
If set to `1` then it turns on a debugging mode.
* `outlib=` - *Optional*, the default value is `work.DFAfcmp.package`.
It points the default location for new generated dynamic
function arrays compiled by FCMP.
*Hint!* Keep it as it is.
* `type=` - *Optional*, the default value is `32`. Sets the type of
bitwise operations executed internaly on the bitmap.
The only valid values are `32` or `52`,
With 32 the `BOR()` and `BAND()` SAS functions are used
and with 52 the `bit64orDFA()` and `bit64and DFA()` FCMP
functions are used.
* `header=` - *Optional*, the default value is `1`. Indicates if
the `proc fcmp outlib = &outlib.;` header is added to
the executed code. If not 1 then no header is added.
**Created function arguments description**:
A function generated by the macro is:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
call &bitmapName.(IO, position, value)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
and accepts the following list of arguments and values:
1. `IO` - is a *character* steering argument, possible
values and behaviour they call are the following:
- `Check`, `Test`, `T` - to get information if a bit is set to 1 (on) or not,
- `On`, `1` - to set a selected bit to 1,
- `Off`, `0` - to set a selected bit to 0,
- `C`, `Clear` - to reduce a bitmat to a single empty cell,
- `A`, `Allocate` - to reserve space for a bitmap and set all bits to 0,
- `A0`, `Allocate0` - to reserve space for a bitmap and set all bits to 0,
- `A1`, `Allocate1` - to reserve space for a bitmap and set all bits to 1,
- `D`, `Dim`, `Dimension` - to returns minimal and maximal index of the bitmap.
2. `position` - is a *numeric* argument and depends on the `IO` value.
Behaves in the following way:
- for `On`, `Off`, `1`, `0`/ `Check`, `Test`, `T` it is a bitmap index,
- for `C`, `Clear` is ignored,
- for `A`, `Allocate` sets the value of the minposition, i.e. the minimal position of the bitmap index,
- for `D`, `Dimension` it returns value of the minposition,
.3 `value` - is a *numeric* argument and depends on the `IO` value.
Behaves in the following way:
- for `Check`, `Test`, `T` it holds value retrieved from a bitmap on a given position,
- for `On`, `Off`, `1`, `0`, `C`, `Clear` is ignored,
- for `A`, `Allocate` it sets the value of the maxposition, i.e. maximal position of the array index,
- for `D`, `Dimension` it returns value of the maxposition
The `position` and the `value` arguments are **outargs**, i.e. can be changed by the function.
### EXAMPLES AND USECASES: ####################################################
**EXAMPLE 1.** Bitmap of type 32:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
%createDFBitmap(MyBitmap32,type=32,debug=1);
options APPEND=(cmplib = WORK.DFAfcmp) ;
data Example1;
call MyBitmap32("Allocate", -10, 100);
L = 0; H = 0;
call MyBitmap32("Dim", L, H);
put L= H=;
* populate array with data ;
do i = L to H by 2;
put i @;
call MyBitmap32("1", i, .);
end;
put;
* get values from the array ;
Value = .;
do i = L to H;
call MyBitmap32("T", i, Value);
put i= Value=;
end;
run;
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
**EXAMPLE 2.** Bitmap of type 52:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
%createDFBitmap(MyBitmap52,type=52,debug=1);
options APPEND=(cmplib = WORK.DFAfcmp) ;
data Example2;
call MyBitmap52("Allocate", -10, 100);
L = 0; H = 0;
call MyBitmap52("Dim", L, H);
put L= H=;
* populate array with data ;
do i = L to H by 2;
put i @;
call MyBitmap52("1", i, .);
end;
put;
* get values from the array ;
Value = .;
do i = L to H;
call MyBitmap52("T", i, Value);
put i= Value=;
end;
run;
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
**EXAMPLE 3.** Execution time test for type 52:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
%createDFBitmap(MyBigBitmap52,type=52,debug=0);
options FULLSTIMER APPEND=(cmplib = WORK.DFAfcmp) ;
data Example3;
call MyBigBitmap52("Allocate", -10, 2000000001);
L = 0; H = 0;
call MyBigBitmap52("Dim", L, H);
put L= H=;
* populate bitmap with data ;
t = time();
do i = L to H by 17;
call MyBigBitmap52("1", i, .);
x + 1;
end;
t = time() - t;
put "populate:" t= x=;
* get values from the bitmap ;
t = time();
Value = .;
do i = L to H;
call MyBigBitmap52("T", i, Value);
x + (-Value);
end;
t = time() - t;
put "search:" t= x=;
run;
%*
L=-10 H=2000000001
populate:t=55.902999878 x=117647060
search:t=654.12900019 x=0
NOTE: The data set WORK.EXAMPLE3 has 1 observations and 6 variables.
NOTE: DATA statement used (Total process time):
real time 11:50.42
user cpu time 11:46.40
system cpu time 0.45 seconds
memory 301791.12k
OS Memory 326332.00k
;
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
**EXAMPLE 4.** Execution time test for type 32:
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~sas
%createDFBitmap(MyBigBitmap32,type=32,debug=0);
options FULLSTIMER APPEND=(cmplib = WORK.DFAfcmp) ;
data Example4;
call MyBigBitmap32("Allocate", -10, 2000000001);
L = 0; H = 0;
call MyBigBitmap32("Dim", L, H);
put L= H=;
* populate bitmap with data ;
t = time();
do i = L to H by 17;
call MyBigBitmap32("1", i, .);
x + 1;
end;
t = time() - t;
put "populate:" t= x=;
* get values from the bitmap ;
t = time();
Value = .;
do i = L to H;
call MyBigBitmap32("T", i, Value);
x + (-Value);
end;
t = time() - t;
put "populate:" t= x=;
run;
%*
L=-10 H=2000000001
populate:t=50.417999983 x=117647060
populate:t=611.13600016 x=0
NOTE: The data set WORK.EXAMPLE4 has 1 observations and 6 variables.
NOTE: DATA statement used (Total process time):
real time 11:02.07
user cpu time 10:59.07
system cpu time 1.46 seconds
memory 489583.90k
OS Memory 513876.00k
;
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
---
## >>> `generateArrays` exec: <<< <a name="createdhprtqueue-exec"></a> #######################
The generateArrays exec file provides a **list of automatically generated examples** of functions
@@ -1112,6 +1557,8 @@ The list of provided examples is the following:
- `PrtQueueNBC` - Dynamic Hash-based Character Priority Queue with *New on Bottom* (length 256 bytes)
- `PrtQueueNTN` - Dynamic Hash-based Numeric Priority Queue with *New on Top*
- `PrtQueueNBN` - Dynamic Hash-based Numeric Priority Queue with *New on Bottom*
- `Bitmap32` - Dynamic Function Bitmap on 32 bit
- `Bitmap52` - Dynamic Function Bitmap on 52 bit
The `outlib=` option is set to `work.DFAfcmp.package`. The `cmplib=` option is updated automatically.

Binary file not shown.

Binary file not shown.

View File

@@ -66,10 +66,10 @@ Package contains:
Required SAS Components:
*Base SAS Software*
*SAS package generated by generatePackage, version 20201115.*
*SAS package generated by generatePackage, version 20210109.*
The SHA256 hash digest for package macroArray:
`AC3AD58AFBBE459616743DC6346330BD8DD33FBA8CDD595423F181B67D0475BC`
`849629D3AF3FE3AB45D86990E303F1D5E4D5F9F31C8ED6864C95B0DFAADCA445`
---
# Content description ############################################################################################

Binary file not shown.

View File

@@ -46,10 +46,10 @@ Package contains:
Required SAS Components:
*Base SAS Software*
*SAS package generated by generatePackage, version 20201115*
*SAS package generated by generatePackage, version 20210109*
The SHA256 hash digest for package SQLinDS:
`CE1A266B9030E5E336B45F53DF483F6913FD8AE88A2884CEE88BEEF621FDBD78`
`1853CD6262CF66582A33C373AA612CA714B61CB88A1C51745E7A57D5A03C39B4`
---
# Content description ############################################################################################

Binary file not shown.