``` .
```prevSearch = compile(tagre("a", "href", r'(%scomic/\d+)' % rurl, after="prev"))```
To search for more comics, Dosage has to look for the previous comic URL.
The ``after=`` value in ``tagre()`` matches anything between the
attribute value and the end of the tag.
So this pattern assumes each comic page URL has a link to the previous
comic, for example ``http://superdupercomic.com/comic/100`` has a
link ````.
``help = 'Index format: n (unpadded)'``
Since the user can search comics from a given start point, the help
must describe how the comic is numbered. Running
``dosage superdupercomic:100`` would start getting comics from number
100 and earlier.
dosage-2.12/doc/authors.txt 0000664 0000000 0000000 00000000271 12270563672 0015705 0 ustar 00root root 0000000 0000000 # Project initiators and past maintainers
Tristan Seligmann
Jonathan Jacobs
# Current maintainer
Bastian Kleineidam
# Patches and other contributions
Tobias Gruetzmacher
Dirk Reiners
dosage-2.12/doc/changelog.txt 0000664 0000000 0000000 00000073031 12270563672 0016153 0 ustar 00root root 0000000 0000000 Dosage 2.12 (released 24.1.2014)
Changes:
- cmdline: The --basepath option now replaces "~" or "~user" with the
users home directory.
- documentation: Added install instructions at doc/install.txt
Fixes:
- comics: Fix AbstruseGoose, AxeCop, BardsWorth, DemolitionSquad.
- comics: Remove broken ChugWorth.
Dosage 2.11 (released 15.1.2014)
Features:
- comics: Added CampComic, EatThatToast, FoulLanguage,
PoorlyDrawnLines and StandStillStaySilent.
Dosage 2.10 (released 5.1.2014)
Features:
- comics: Comic strips are downloaded in parallel. To prevent overload
of comic sites, no more than one download thread per host is allowed.
Changes:
- cmdline: Ensure only one instance of dosage is running to prevent
accidental DoS when fetching multiple comics of one site.
- comics: Wait up to 1 second between two URL page downloads.
Dosage 2.9 (released 22.12.2013)
Features:
- events: Ensure maximum display width on RSS and HTML images.
- comics: Added EdmundFinney, Gaia, GaiaGerman, InternetWebcomic,
NotInventedHere, RedsPlanet, RomanticallyApocalyptic,
ScandinaviaAndTheWorld, TheGamerCat, Weregeek.
Thanks to Null000 for the patches.
Closes: GH bug #48
Fixes:
- comics: Get larger images from GoComics.
- comics: Fix AbstruseGoose and QuestionabelContent.
Closes: GH bug #50
Dosage 2.8 (released 8.12.2013)
Features:
- comics: Added image text saving for comic strips.
Used in xkcd and AbstruseGoose comics to store the
image title text.
Closes: GH bug #42
Fixes:
- comics: Fixed ForLackOfABetterComic.
- comics: Store large xkcd images if available.
Closes: GH bug #43
Dosage 2.7 (released 24.11.2013)
Fixes:
- comics: Fixed GoComic image URL matcher.
- comics: Fixed AxeCop, PensAndTales_FireflyCross.
- comics: Remove broken ComicFury_Rosie, InsideOut, SodiumEyes.
Dosage 2.6 (released 12.11.2013)
Features:
- comics: Added DarthsAndDroid
- docs: Document how to add new comics in docs/adding_new_comics.txt
Closes: GH bug #39
Fixes:
- comics: Fixed all DrunkDuckk comics since the domain has moved.
- comics: Fixed AllTheGrowingThings, AxeCop, BookOfBiff, BroodHollow,
Carciphona, CatAndGirl, CatsAndCameras, ChainsawSuit, ElGoonishShive,
EvilInc, Garanos, GleefulNihilism, LeastICouldDo, MysteriesOfTheArcana,
NineteenNinetySeven, NoNeedForBushido, Oglaf, OneQuestion,
OverCompensating, ScenesFromAMultiverse, Shivae, Spinnerette,
Wigu, Wonderella, Wulffmorgenthaler
Closes: GH bug #41
- comics: Removed broken AetheriaEpics, ChuckBrain, Fallen, HMHigh,
IanJay, InsideOut, Nodwick, WebcomicsNation_ClownSamurai
Changes:
- cmdline: Display genres in module help (dosage -m).
Dosage 2.5 (released 18.7.2013)
Features:
- comics: Added EatLiver, ICanBarelyDraw, JimBenton, MarriedToTheSea
and NatalieDee.
Closes: GH bug #37
Fixes:
- comics: Fixed AxeCop, GoblinsComic, KevinAndKell and other comics.
Dosage 2.4 (released 24.6.2013)
Features:
- comics: Added LinuxComFridayFunnies and OnTheFasttrack.
Fixes:
- cmdline: The --continue option fetched only one image.
Closes: GH bug #32
Dosage 2.3 (released 26.5.2013)
Features:
- scripts: Added script to create a CBZ archive for a given comic
directory.
Fixes:
- comics: Fix LookingForGroup and other comics.
Closes: GH bug #31
Dosage 2.2 (released 30.4.2013)
Features:
- comics: Added ARedTailsDream, Carciphona, Curtailed, GirlGenius,
Lackadaisy, SabrinaOnline, TheDreamlandChronicles, TwoGuysAndGuy
and Unsound. Patches by Dirk Reiners.
Closes: GH bug #29
- comics: Comics which are not updated anymore can now be marked.
Closes: GH bug #30
Changes:
- cmdline: Ignore trailing '/' at end of comic names. Useful
when using shell completion to pick comics. Patch by Dirk Reiners.
Fixes:
- comics: Fix DorkTower, MadamAndEve and Saturday Morning Breakfast
Cereal, and improve image filenames of CtrlAltDel.
Patches by Dirk Reiners.
Dosage 2.1 (released 14.4.2013)
Features:
- comics: Add some comic descriptions from their webpages.
Fixes:
- cmdline: Fix output encoding errors on comic listing.
Closes: GH bug #24
Dosage 2.0 (released 11.4.2013)
Features:
- comics: Added DamnLol, EverydayBlues, ExtraOrdinary,
ForLackOfABetterComic, GoblinsComic, RealmOfAtland, Science,
SnowFlakes, StuffNoOneToldMe, WebDesignerCOTW and ZenPencils.
- comics: Added the --vote option to vote for popular comics.
Changes:
- cmdline: Remove deprecated mainline script.
Fixes:
- install: Add install_requires to setup.py to fix pip install.
Closes: GH bug #22
- comics: Fixed Curvy, DasLebenIstKeinPonyhof, ExtraLife, EyeOfRamalach,
KatzenfutterGeleespritzer, Oglaf, Precocious, SnowFlame.
Closes: GH bug #23
- comics: Removed CaribbeanBlue, GreystoneInn, SarahZero.
Dosage 1.15 (released 1.4.2013)
Features:
- comics: Added DrMcNinja, Schuelert.
- output: Added a new JSON output logger.
Changes:
- comics: Add better source for HagarTheHorrible
Closes: GH bug #21
- output: Display error traceback information in verbose mode.
Fixes:
- comics: Fixed GoComics by downloading zoomed images,
fixed WorlWorldSaga* and Eriadan, and removed DerFlix.
Dosage 1.14 (released 21.3.2013)
Features:
- comics: Added KeenSpot comic strips and enable ComicGenesis
comic strips
- comics: Added CucumberQuest, DasLebenIstKeinPonyHof, DemolitionSquad,
DerFlix, DerTodUndDasMaedchen, DogHouseDiaries, FonFlatter,
FullFrontalNerdity, GeeksNextDoor, Hipsters, KatzenfutterGeleespritzer,
KickInTheHead, MyCartoons, OrnerBoy, ParallelUniversum, Ruthe,
SandraAndWooGerman, WormWorldSaga.
Closes: GH bug #15, #19
Changes:
- comics: The scraper can check a list of previous and image link
regular expressions, not only a single one.
- comics: Continue searching for images if one image is not found.
Closes: GH bug #18
Fixes:
- comics: Fix dilbert image naming.
Closes: GH bug #20
Dosage 1.13 (released 11.3.2013)
Features:
- comics: Added comic strips AhoiPolloi, AxeCop, Bearmageddon, DeadWinter,
HarkAVagrant, IAmArg, LoadingArtist, Nnewts, PHDComics, PokeyThePenguin,
SnowFlame, WorldOfMrToast and Zwarwald.
Changes:
- cmdline: Comic lists are displayed one page at a time.
- output: HTML output embeds the images in the page and show the page URLs.
- output: The --output option can be given multiple times.
Fixes:
- cmdline: Catch error when piping output to another
program or file under Windows.
Closes: GH bug #13
- cmdline: Catch error when multiple comics match.
Closes: GH bug #16
- comics: Retry download on empty content to reduce empty file errors.
- comics: Don't save thumbnails in LookingForGroup
Closes: GH bug #17
Dosage 1.12 (released 4.3.2013)
Features:
- comics: Added comic strips AlphaLuna, AlphaLunaSpanish, BrentalFloss
BrentalFlossFit, BrentalFlossGuest, DangerouslyChloe, MagickChicks,
MenageA3, Namesake, ShadowGirls, StickyDillyBuns.
Fixes:
- cmdline: Fix option parsing for -l, --singlelist and --version.
Closes: GH bug #10
- comics: Ensure the file is written to disk on save and detect
empty files as an error.
Closes: GH bug #11
Dosage 1.11 (released 1.3.2013)
Features:
- comics: Added comic strips Caggage, ManlyGuysDoingManlyThings,
SandraAndWoo and SupernormalStep.
Changes:
- comics: Always use connection pooling when downloading pages or files.
- cmdline: Replace the deprecated argument parser optparse with argparse.
- installation: The Windows installer now adds a help entry to the start menu
and has a flag to add dosage.exe to the PATH.
Fixes:
- comics: Correct the list of characters not to quote for URL path encoding.
This fixes a lot of download errors of DrunkDuck comics.
- comics: Fixed a lot of comic strips (see git log for details).
Closes: GH bug #8
Dosage 1.10 (released 10.2.2013)
Features:
- comics: Added comic strips SequentialArt, VampireCheerleader,
GrrlPower, Spinnerette, HijinksEnsue, Nedroid, Antics, ChannelAte,
ToonHole, ThisIsIndexed, WastedTalent, ChainsawSuit, ThreePanelSoul,
SpaceTrawler, ScenesFromAMultiverse, BroodHollow, BoxerHockey,
Wonderella, BadMachinery, TheBrads, FirstWorldProblems,
OmakeTheater, SkinDeep, ParadigmShift.
Changes:
- cmdline: Added the --continue option.
- output: Add encoding, inline images and guid tags to RSS output.
Fixes:
- comics: Fixed Gunnerkrigcourt comic strip.
Dosage 1.9 (released 28.1.2013)
Features:
- comics: Added AmazingSuperPowers comic strip.
- comics: Added PandyLand comic strip.
- comics: Added all comic strips from Arcamax (eg. including
Hagar the horrible).
- documentation: Document parallel download example with xargs
on Unix systems.
Changes:
- comics: CyanideAndHappiness image filename now has the strip number prefixed.
- comics: Indexed retrieval can now retrieve all (-a) or some (-n)
strips, not only one.
Fixes:
- comics: Fixed LeastICouldDo image URL.
Closes: GH bug #1
- comics: Fix URL norming.
Closes: GH bug #2
- documentation: Fix wrong option name: it's -a instead of -c.
Closes: GH bug #3
- comics: Fix UnboundLocalError when using indexed retrieval.
Closes: GH bug #4
- scripts: Ensure the generated comic names do not exceed 100 characters so
they do not cause problems with path length restrictions.
- installation: Set correct homepage url so "pip install dosage" works.
Closes: GH bug #5
Dosage 1.8 (released 20.12.2012)
Changes:
- comics: Add compatibility to requests module >= 1.0.
- comics: Updated the comic list with the generator scripts.
Dosage 1.7 (released 18.12.2012)
Features:
- cmdline: Added proper return codes for error conditions.
- comics: Added more robust regular expressions for HTML tags.
They match case insensitive and ignore whitespaces now.
- comics: Use the python-requests module for HTTP requests.
- comics: Respect the robots.txt of downloaded HTML pages
Changes:
- installation: Added support for dynamic configuration values.
- installation: Require and use Python 2.7
- comics: Removed the twisted and zope dependencies by adding
an internal plugin search mechanism.
- comics: Replace the disable mechanism with an adult option.
- comcis: Add scripts to automate comic listings for Creators, Universal,
KeenSpot, GoComics and DrunkDuck.
- testing: Refactored the test comic routine into fully automatic and
complete tests cases for every comic.
- cmdline: Improved terminal feature detection.
Fixes:
- comics: Fix all comics!
- comics: Don't add empty URLs to the list of found URLs.
Dosage v.1.6.0:
* The "Not Dead Yet" release.
* Added / Fixed / etc. comics:
- Too many to list, really.
* New dependencies:
- Twisted
- zope.interface (not zope)
* Revamped plugin system, the first step on the road to Twisted.
Dosage v.1.5.8:
* Added comics:
- BonoboConspiracy
- ChasingTheSunset
- Comedity
- GoneWithTheBlastwave
- KeenSpot/* -- a *LOT* of KeenSpot submodules
- NichtLustig
- OtenbaFiles
- Wulffmorgenthaler
- Y
* Fixed comics:
- AbstractGender
- AlienLovesPredator
- AppleGeeks
- EarthsongSaga
- NewWorld
- WhiteNinja
* Moved comics:
- KeenSpot/CatLegend (previously CatLegend)
- All KeenSpot/* comic subnames no longer have "The" prefixes.
- UClick (replaces UComics and UComicsEspanol)
* Removed comics:
- KeenSpot/TheDevilsPanties (duplicate of KeenSpot/DevilsPanties)
Dosage v.1.5.7:
* Important SmackJeeves module fix. Catchup used to loop around from the
first strip to the last one, thus potentially hammering the SmackJeeves
servers with floods of requests from neverending catchups.
* Added comics:
- AbleAndBaker
- AcademyVale
- Aikida
- Angels2200
- BetterDays
- BlankLabel (virtual module)
- BoredAndEvil
- Catharsis
- ChuckAndElmo
- CloneManga/PennyTribute
- CourtingDisaster
- DeathToTheExtremist
- DogComplex
- DownToEarth
- Dracula
- DragonTails
- DrFun
- DungeonCrawlInc
- ExtraLife
- FalconTwin
- FightCastOrEvade
- Flipside
- Housd
- JerkCity
- JoeAndMonkey
- KeenSpot/SuicideForHire
- LasLindas
- Nekobox
- Nervillsaga
- NewAdventures
- NewAdventuresOfBobbin
- Nihilism
- Nukees
- OkayPants
- PartiallyClips
- PensAndTales
- RWWR
- WebcomicsNation (virtual module)
- Yirmumah
* Fixed comics:
- Asif
- CatLegend
- CloneManga/NanasEverydayLife
- CloneManga/PaperEleven
- DrunkDuck (various comics no longer present)
- EarthsongSaga
- ErrantStory
- InkTank
- KeenSpot/
The index name itself usually is the part of the comic strip URL that identifiess a strip, eg. a number or a date. The expected format is documented when using the --modulehelp option.
INDEX SYNTAX can not be used with SPECIAL SYNTAX.
Retrieve the current comic of Cyanide and Happiness:
Retrieve the current strip of all comics in your Comics directory:
Vote for the comics in your Comics directory:
Retrieve the current strip of every comic that there is a module for:
Retrieve the Penny Arcade strip for a given index:
Retrieve Calvin and Hobbes strips from a given index going backwards to the beginning.
At the time of writing, a complete Dosage collection weighs in at around 3.0GB.
Else the return value is zero.