Roundup Tracker - Issues

Issue 2551027

classification
Title: wiki outgoing email does not work on sourceforge when running own wiki
Type: Severity: normal
Components: Infrastructure Versions:
process
Status: new Resolution:
Dependencies: Superseder:
Assigned To: Nosy List: ThomasAH, ber, rouilj, schlatterbeck
Priority: Keywords:

Created on 2019-03-07 08:25 by ber, last changed 2019-03-20 11:12 by rouilj.

Messages
msg6368 Author: [hidden] (ber) Date: 2019-03-07 08:25
The wiki of our roundup-development is currently hosted on Sourceforge
(for a number of years).

To confirm registrations, for notifications to reset password,
an outgoing email service is nice.

However Sourceforge stopped outgoing email service according to
 https://sourceforge.net/p/forge/site-support/15404/
the official support said that they had to stop all outside communication
of scripts because of abuse and their perceived legal obligation to
prevent it.
This is understandable. Thanks to Sourceforge for offering such a nice
service
for many years!

The problem be seen current if a password reset is attempted, 
it fails with "Connection to mailserver 'prwebmail' failed: [Errno 113]
No route to host"

So we have to look for alternatives.
Ideas:


a) We activate SF's own wiki service
  https://sourceforge.net/p/forge/documentation/Wiki/

  For this we would have to transform the old contents into the
different format,
  they use Markdown.
  Advantages: No extra credentials necessary, already integrated with
SF. HTTPS access.
  We do not have to maintain the wiki software itself.

b) We search for a different MoinMo.in provider
  Advantage: We are the customers as we will be paying (a low amount),
transforming
  contents is easy, we profit from an independent fully blown wiki
component and also
  promote it. HTTPS and email included.

c) We search for a hoster that offers us to run something.
  Advantage: We have full control. And the advantages of a full blown
competitive wiki engine.


We could ask the PSF that already runs our tracker hosting or Intevation
(my company),
which would fall between the b) and c) as Intevation runs a lot of
Moinmo.in wikis.

Give your feedback into the issue! (Thanks!)
msg6369 Author: [hidden] (ber) Date: 2019-03-07 08:56
Here is a list of Hoster for MoinMo.in instances
  https://moinmo.in/MoinMoinHosting
some entries seem to be outdated, there are only two hosters offering
a pre-installed MoinMoin and pricing starts at 180 USD/year.

Other lists of wiki hosters can be found here:
* https://en.wikipedia.org/wiki/Comparison_of_wiki_hosting_services
* https://www.mediawiki.org/wiki/Hosting_services

Given that our wiki requirements for roundup are low and
most of us want to spend less time administrating the wiki and more
into roundup development, my tendency right now is to move to SF's service.
SF runs Allura, which is a Free Software product, we maybe able to
become more of a customer if we volunteeringly pay.
msg6370 Author: [hidden] (rouilj) Date: 2019-03-07 23:00
Hi Bern:

In message <1551947118.97.0.680049436588.issue2551027@roundup.psfhosted.org>,
Bernhard Reiter writes:
>So we have to look for alternatives.
>Ideas:
>a) We activate SF's own wiki service
>  https://sourceforge.net/p/forge/documentation/Wiki/
>
>  For this we would have to transform the old contents into the
>  different format, they use Markdown.
>  Advantages: No extra credentials necessary, already integrated
>    with SF. HTTPS access.
>  We do not have to maintain the wiki software itself.
>
>b) We search for a different MoinMo.in provider
>  Advantage: We are the customers as we will be paying (a low amount),
>    transforming contents is easy, we profit from an independent
>    fully blown wiki component and also promote it. HTTPS and email included.
>
>c) We search for a hoster that offers us to run something.
>  Advantage: We have full control. And the advantages of a full blown
>    competitive wiki engine.

I have a few concerns:

 1) No loss/corruption of content. We have a lot of content that,
    because it includes python code, is brittle to
    transfer. Whitespace gets mangled easily and that causes semantic
    changes and bugs in python code. I have spent quite a few hours
    fixing pages in the wiki where whitespace rot has occurred.
 2) Anti-Spam controls. This was a problem in the past and is a
    concern for the future. Having a way to scrub spam if it occurs is
    going to be important. A way to control access (require magic key,
    or authorize users) to the wiki is a needed control if we wbend up
    in spam city.
 3) Vendor lock-in. The only thing I want to get locked into is
    roundup 8-).
 4) Support for HTTPS, RSS, and file/image attachments.
 4a) Being able to embed an attachment in the wiki page with syntax
    highlighting would be a nice to have. This would allow python code
    to be attached and the user can downloaded the file (preserving
    whitespace) rather than cut/paste.

It looks like the sourceforge wiki handles #4 but not #4a. I hope
because it ties into sourceforge, #2 is not an issue. #3 is an issue.
But if it reduces maintenance and we have some way to export the
content I am ok with it.

#1 is going to be the tricky issue. That argues for option b if
somebody is willing to pay for it.
msg6371 Author: [hidden] (ber) Date: 2019-03-08 08:23
Hi John,
thanks for your thoughts, which turn out to be more detailed requirements
we should weight in. I agree with all of them.

Yesterday I took an initial look about option a) (moving to SF) and
found out
the following:

i) we have 14MByte in the `data` directory, there seem to be many pages
   that got deleted as spam. And also there is a lot of history.

-> We should backup and clean out contents before we start "moving" in
all cases.
-> How many history do we want to preserve?

== History
Overall I like keeping history, with SCMs I think it is important, though
with our wiki I think it is an open question.

Option a) would not preserve history, which can be fine, if this is what
we want.
This holds for any other migration as well.

== Exploring Option b) and c)
Intevation maybe willing to contribute financially for a hoster. 
I'll ask Thomas Waldmann if there is a different option than the
business option
 his company is offering, which I think maybe unsuitable for a Free
Software initiative.

Maybe should approach the PSF and ask if this is something where they
would be willing
to help or rather not.
msg6372 Author: [hidden] (ber) Date: 2019-03-08 08:28
== a) needs conversion to a different markup

Documented I've found two possible ways to explore first:
1. Use moin2rst Formatter https://moinmo.in/FormatterMarket
   and additional scripting to get to rSt and
   then pandoc to convert to something else.

2. Use a html export and then pandoc.

It maybe an advantage if we could convert to a widely used Wikimarkup
like markdown variants. Regarding independence.

Both would require additional scripting.
msg6373 Author: [hidden] (ThomasAH) Date: 2019-03-08 08:31
Thomas Waldmann offers free wikis for Free Software, see
https://wikiwikiweb.de/FreeWiki
msg6374 Author: [hidden] (ber) Date: 2019-03-08 09:21
@ThomasAH, thanks for the hint.
In a narrow sense we do not meet the conditions for
https://wikiwikiweb.de/FreeWiki and I would want us to be customers.
I've written to  www.waldmann-edv.de to ask if there is a special offer
which is diffrent
from
https://order.shareit.com/product?vendorid=200089151&productid=300307419
msg6375 Author: [hidden] (ber) Date: 2019-03-08 09:42
== Option a) move to SF wiki
=== Code highlighting, inclusion

It seems that code highlighting works with SF's version of markdown:
 https://sourceforge.net/p/forge/documentation/markdown_syntax/#md_ex_code

Also it is possible to include files in a page, so the only question
would be if they would also be syntax highlighted.
msg6376 Author: [hidden] (ber) Date: 2019-03-08 10:06
== Option a) move to SF wiki
=== Code highlighting, inclusion
Inclusion of files with highlighting seems to work, see example at

https://sourceforge.net/p/roundup/wiki/SandBox/
msg6381 Author: [hidden] (rouilj) Date: 2019-03-08 14:26
Hi Bern:

In message <1552039613.38.0.724418710885.issue2551027@roundup.psfhosted.org>,
Bernhard Reiter writes:
>== Option a) move to SF wiki
>=== Code highlighting, inclusion
>Inclusion of files with highlighting seems to work, see example at
>
>https://sourceforge.net/p/roundup/wiki/SandBox/

That's an example of including a file from the repo. I meant including
an attached file inline in the wiki article. That doesn't seem to be
possible. There is an example of including an attached image, but I
didn't find any mention of including an attached (python) file inline.
msg6382 Author: [hidden] (ber) Date: 2019-03-08 16:25
== Option a) move to SF wiki
A drawback is that there are tags, but no hierachy of pages on SF.

A plus is, that the javascript editor is quite nice.

=== Code highlighting, inclusion
Added a feature request to SF
https://sourceforge.net/p/forge/feature-requests/692/
msg6404 Author: [hidden] (ber) Date: 2019-03-19 12:12
Hello!

After an explanation what we need, the small company
www.waldmann-edv.de from Moinmoin's maintainer Thomas Waldmann
makes us an offer to host an instance for 15 €/month payable in
a yearly installment.

To be checked:
* Does our custom style run on verison 1.9 (we are still using 1.8)
* Do we have any plugins or other customizations in use? (I guess we don't)

If we need one time (a project) support to migrate or for anything special,
we can get an offer by www.waldmann-edv.de, which will be a maximum of
90 €/h.
(All prices are stated with out potential VAT.)

In my personal observation 180 €/year will be saved
just on time to keep Moinmoin updated because of the experience of
Thomas Waldman. It is my understanding that we could move off this
hosting any time (and not renew payment for the next year). 

What do you think about the offer?

Note that my company Intevation would be willing bear the costs for this or
another solution for a foreseeable time. (Probably as long as we use
roundup intensively). A costs of 180 €/h year would probably be bearable
by others if Intevation would stop financing this.
msg6405 Author: [hidden] (schlatterbeck) Date: 2019-03-19 13:02
On Tue, Mar 19, 2019 at 12:12:38PM +0000, Bernhard Reiter wrote:
...
> makes us an offer to host an instance for 15 €/month payable in
> a yearly installment.

As far as I understand, SF has native support for markdown (which
doesn't lock us into something), so I'd go with the standard free
offering. Unless the effort to convert to SF format is really huge.

Ralf
-- 
Dr. Ralf Schlatterbeck                  Tel:   +43/2243/26465-16
Open Source Consulting                  www:   http://www.runtux.com
Reichergasse 131, A-3411 Weidling       email: office@runtux.com
msg6406 Author: [hidden] (ber) Date: 2019-03-20 07:17
Hi Ralf,

according to our evaluation so far, the SF wiki does **not meet**
the following features which are used by us right now:

* inline display of attached files (so that code examples can be
contributed)
* subpages, to be able to build a tree of wiki pages

So we are considering our options.
A markup conversion would be a medium chunk of work from my current
understanding.

If time is saved updating a wiki installation by us, it would mean more
time for roundup development.
msg6408 Author: [hidden] (rouilj) Date: 2019-03-20 11:12
Hi Bern:

In message <1553066228.0.0.459229370472.issue2551027@roundup.psfhosted.org>,
Bernhard Reiter writes:
>Bernhard Reiter added the comment:
>according to our evaluation so far, the SF wiki does **not meet**
>the following features which are used by us right now:
>
>* inline display of attached files (so that code examples can be contributed)

I raised the use case of embedding of attached files of source code.
I just checked: https://moinmo.in/HelpOnLinking and it doesn't look
like moinmoin handles that. They have documentation on embedding
images, but not source files.

I must have been thinking of some other wiki platform.

So I don't think this is an issue with the SF tracker.

>* subpages, to be able to build a tree of wiki pages

This would be useful.

>So we are considering our options.
>A markup conversion would be a medium chunk of work from my current
>understanding.

This is of more concern especially preserving whitespace in examples.

>If time is saved updating a wiki installation by us, it would mean more
>time for roundup development.

This is also a benefit from being able to move to another moinmoin platform.

Sorry for the embedding confusion. I could have sworn I had used the feature.
History
Date User Action Args
2019-03-20 11:12:06rouiljsetmessages: + msg6408
2019-03-20 07:18:46berlinkissue2551032 superseder
2019-03-20 07:17:07bersetmessages: + msg6406
2019-03-19 13:02:17schlatterbecksetmessages: + msg6405
2019-03-19 12:12:38bersetmessages: + msg6404
2019-03-08 16:25:22bersetmessages: + msg6382
2019-03-08 14:26:59rouiljsetmessages: + msg6381
2019-03-08 10:06:53bersetmessages: + msg6376
2019-03-08 09:42:09bersetmessages: + msg6375
2019-03-08 09:21:14bersetmessages: + msg6374
2019-03-08 08:31:05ThomasAHsetmessages: + msg6373
2019-03-08 08:28:03bersetmessages: + msg6372
2019-03-08 08:23:13bersetmessages: + msg6371
2019-03-07 23:00:50rouiljsetmessages: + msg6370
2019-03-07 08:56:52bersetmessages: + msg6369
2019-03-07 08:25:18bercreate