Cleanup SCANNER_DEBUG and don't NUL terminate work buffer

Use emalloc and friends. Since we reuse all buffers, this does not affect
the speed.

The smart_str_* functions don't NUL terminate strings anymore. We can
rely on the length of the s

Use emalloc and friends. Since we reuse all buffers, this does not affect
the speed.

The smart_str_* functions don't NUL terminate strings anymore. We can
rely on the length of the strings completely.

show more ...

Remove this pseudo optimization from the previous rewrite.

Since we leave/enter the loop more often, the cost of maintaining
c_arg/c_val is higher than simply copying the tag/arg string

Remove this pseudo optimization from the previous rewrite.

Since we leave/enter the loop more often, the cost of maintaining
c_arg/c_val is higher than simply copying the tag/arg string once.

show more ...

Another 5%-10% speed increase achieved by

- making ctx->val read-only
- adding a special appendc function for appending single characters

Add support for URLs containing NAME info (for scrolling; #name).

2nd Rewrite of the main scanner engine. This version is cleaner and faster.

It handles the following tags currently:

<FRAME .. SRC=URL ..>
<INPUT .. TYPE=IMAGE SRC=URL ..>
<

2nd Rewrite of the main scanner engine. This version is cleaner and faster.

It handles the following tags currently:

<FRAME .. SRC=URL ..>
<INPUT .. TYPE=IMAGE SRC=URL ..>
<A .. HREF=URL ..>
<AREA .. HREF=URL ..>
<IMG .. SRC=URL ..>

Additional ones can be added within seconds.

The support for HTML forms has been significantly improved. The scanner
will now add proper Hidden Fields for the Session ID.

show more ...

Reduce the amount of copying in the mainloop. We copy tag/arg only, if we
need to preserve them for a new loop iteration (after we leave mainloop).
Otherwise, we can just let them point to th

Reduce the amount of copying in the mainloop. We copy tag/arg only, if we
need to preserve them for a new loop iteration (after we leave mainloop).
Otherwise, we can just let them point to the work area.

show more ...

Revert part of last commit. I'll refine it later.

Another speedup by avoiding string copies.

15% speed gain in test case (rewriting 1M URLs).

Remove nextiter label

s/DEBUG/SCANNER_DEBUG/. "Convert" one macro to inline function to be more
consistent. Also use continue.

Fix a few build bugs, still no go

Add new URL scanner. This version is up to 20% faster. It will be
enabled by default once I'm sure that it works in every case.

To enable it, apply s/url_adapt_ext/url_adapt_ext_ex/ to s

Add new URL scanner. This version is up to 20% faster. It will be
enabled by default once I'm sure that it works in every case.

To enable it, apply s/url_adapt_ext/url_adapt_ext_ex/ to session.c

show more ...