Distributed Wikipedia Project - Revision history

Dwp: /* My idea detailed - Anthony */

2007-08-14T01:26:25Z

My idea detailed - Anthony

←Older revision		Revision as of 01:26, 14 August 2007
Line 26:		Line 26:
	<s>Initial implementation: I'm thinking a vmware player virtual machine running linux (as the guest). The advantage is speed of design. Almost all the software to do this is already out there, the problem becomes one of configuring a system. The significant disadvantage is that it relies on proprietary freeware, but this would only be for a reference implementation. The protocol would work with a reimplemented client/server which doesn't rely on vmware, and work could begin on that once the virtual machine was working. Eventually no one would have to use the initial implementation - just look at all the different implementations of bittorrent for instance.</s>		<s>Initial implementation: I'm thinking a vmware player virtual machine running linux (as the guest). The advantage is speed of design. Almost all the software to do this is already out there, the problem becomes one of configuring a system. The significant disadvantage is that it relies on proprietary freeware, but this would only be for a reference implementation. The protocol would work with a reimplemented client/server which doesn't rely on vmware, and work could begin on that once the virtual machine was working. Eventually no one would have to use the initial implementation - just look at all the different implementations of bittorrent for instance.</s>

-	[[Qemu]] has now progressed to the point where it is a viable product for the initial implementation. It's currently slow, but should be usable for webhosting.	+	[[Qemu]] has now progressed to the point where it is a viable product for the initial implementation. It's currently slow, but should be usable for webhosting. And unlike VMWare, there's no installation process. You could stick it on a usb drive and run it from anywhere.

	This is a rather quick dump of what I've been thinking about on and off over the course of years. Please, ask me questions and lets get a more detailed design. Or maybe you just wanted to take things in a totally different direction? I haven't yet seen TiddlyWiki. Maybe they've already solved the problems and they're the way to go...		This is a rather quick dump of what I've been thinking about on and off over the course of years. Please, ask me questions and lets get a more detailed design. Or maybe you just wanted to take things in a totally different direction? I haven't yet seen TiddlyWiki. Maybe they've already solved the problems and they're the way to go...

Dwp: /* My idea detailed - Anthony */

2007-08-14T01:23:07Z

My idea detailed - Anthony

←Older revision		Revision as of 01:23, 14 August 2007
Line 24:		Line 24:
	* Anonymity - We don't really want mirrors to be able to track users. Fortunately this one has already been solved. Anonymity-conscious users can access Wikipedia through the Tor network. Tor hidden services can be set up to make this less draining on the Tor system (as hidden services don't require open exit nodes). Servers can run the hidden service, the open wiki, or both.		* Anonymity - We don't really want mirrors to be able to track users. Fortunately this one has already been solved. Anonymity-conscious users can access Wikipedia through the Tor network. Tor hidden services can be set up to make this less draining on the Tor system (as hidden services don't require open exit nodes). Servers can run the hidden service, the open wiki, or both.

-	Initial implementation: I'm thinking a vmware player virtual machine running linux (as the guest). The advantage is speed of design. Almost all the software to do this is already out there, the problem becomes one of configuring a system. The significant disadvantage is that it relies on proprietary freeware, but this would only be for a reference implementation. The protocol would work with a reimplemented client/server which doesn't rely on vmware, and work could begin on that once the virtual machine was working. Eventually no one would have to use the initial implementation - just look at all the different implementations of bittorrent for instance.	+	<s>Initial implementation: I'm thinking a vmware player virtual machine running linux (as the guest). The advantage is speed of design. Almost all the software to do this is already out there, the problem becomes one of configuring a system. The significant disadvantage is that it relies on proprietary freeware, but this would only be for a reference implementation. The protocol would work with a reimplemented client/server which doesn't rely on vmware, and work could begin on that once the virtual machine was working. Eventually no one would have to use the initial implementation - just look at all the different implementations of bittorrent for instance.</s>
		+
		+	[[Qemu]] has now progressed to the point where it is a viable product for the initial implementation. It's currently slow, but should be usable for webhosting.

	This is a rather quick dump of what I've been thinking about on and off over the course of years. Please, ask me questions and lets get a more detailed design. Or maybe you just wanted to take things in a totally different direction? I haven't yet seen TiddlyWiki. Maybe they've already solved the problems and they're the way to go...		This is a rather quick dump of what I've been thinking about on and off over the course of years. Please, ask me questions and lets get a more detailed design. Or maybe you just wanted to take things in a totally different direction? I haven't yet seen TiddlyWiki. Maybe they've already solved the problems and they're the way to go...

Dwp: /* My idea detailed - Anthony */

2007-08-14T01:18:58Z

My idea detailed - Anthony

←Older revision		Revision as of 01:18, 14 August 2007
Line 20:		Line 20:
	* Authentication - with a standard Wikipedia mirror, the host is free to change anything. This is in some ways a good thing, but there should at least be a way to designate some sort of "official" version of a file. The way I see doing this is with digital signatures. At the least Wikipedia would have a public/private keypair and could sign articles for its users. In a more advanced version each user could have a public/private keypair and Wikipedia's signature would only be needed upon account creation. The issue with this is I'm not sure it can be easily done in standard java/javascript (without resorting to signed applets which can basically do anything). Maybe I'm wrong there, but if not there would need to be a special client to handle this. That's OK though, people could still test out the system without downloading the client, they just wouldn't be sure of the authentication. As for the client, a simple proxy-type program would work which checked the signatures.		* Authentication - with a standard Wikipedia mirror, the host is free to change anything. This is in some ways a good thing, but there should at least be a way to designate some sort of "official" version of a file. The way I see doing this is with digital signatures. At the least Wikipedia would have a public/private keypair and could sign articles for its users. In a more advanced version each user could have a public/private keypair and Wikipedia's signature would only be needed upon account creation. The issue with this is I'm not sure it can be easily done in standard java/javascript (without resorting to signed applets which can basically do anything). Maybe I'm wrong there, but if not there would need to be a special client to handle this. That's OK though, people could still test out the system without downloading the client, they just wouldn't be sure of the authentication. As for the client, a simple proxy-type program would work which checked the signatures.

-	* Bandwidth - ~~Mirrors~~ rely on the main Wikipedia to get their content. This doesn't save much if any money for Wikipedia. The solution to this is pretty obvious. The mirrors will get their information from other mirrors. With the support of the Wikimedia Foundation the main Wikipedia site could be deprecated to where it only handles signatures. Even without their support certain client/servers could be set up to use the IRC channel to monitor changes and then download them as they come.	+	* Bandwidth - Current mirrors rely on the main Wikipedia to get their content. This doesn't save much if any money for Wikipedia. The solution to this is pretty obvious. The mirrors will get their information from other mirrors. With the support of the Wikimedia Foundation the main Wikipedia site could be deprecated to where it only handles signatures. Even without their support certain client/servers could be set up to use the IRC channel to monitor changes and then download them as they come.

	* Anonymity - We don't really want mirrors to be able to track users. Fortunately this one has already been solved. Anonymity-conscious users can access Wikipedia through the Tor network. Tor hidden services can be set up to make this less draining on the Tor system (as hidden services don't require open exit nodes). Servers can run the hidden service, the open wiki, or both.		* Anonymity - We don't really want mirrors to be able to track users. Fortunately this one has already been solved. Anonymity-conscious users can access Wikipedia through the Tor network. Tor hidden services can be set up to make this less draining on the Tor system (as hidden services don't require open exit nodes). Servers can run the hidden service, the open wiki, or both.

Andy753421 at 10:58, 18 February 2007

2007-02-18T10:58:31Z

←Older revision		Revision as of 10:58, 18 February 2007
Line 32:		Line 32:
	*[[Wikipedia:nl:gebruiker:dedalus\|Dedalus]] = [[User:Dedalus\|Dedalus]] 14:44, 29 December 2006 (EST)		*[[Wikipedia:nl:gebruiker:dedalus\|Dedalus]] = [[User:Dedalus\|Dedalus]] 14:44, 29 December 2006 (EST)
	*[[User:Anthony\|Anthony]] 06:33, 31 December 2006 (EST)		*[[User:Anthony\|Anthony]] 06:33, 31 December 2006 (EST)
		+	*[[User:Andy753421\|Andy Spencer]] 10:57, 18 Feb 2007 (UTC)

	==Links==		==Links==
	*http://lists.wikimedia.org/pipermail/wikitech-l/2007-February/029707.html		*http://lists.wikimedia.org/pipermail/wikitech-l/2007-February/029707.html

A: /* Participants */

2007-02-17T16:31:59Z

Participants

←Older revision		Revision as of 16:31, 17 February 2007
Line 32:		Line 32:
	*[[Wikipedia:nl:gebruiker:dedalus\|Dedalus]] = [[User:Dedalus\|Dedalus]] 14:44, 29 December 2006 (EST)		*[[Wikipedia:nl:gebruiker:dedalus\|Dedalus]] = [[User:Dedalus\|Dedalus]] 14:44, 29 December 2006 (EST)
	*[[User:Anthony\|Anthony]] 06:33, 31 December 2006 (EST)		*[[User:Anthony\|Anthony]] 06:33, 31 December 2006 (EST)
		+
		+	==Links==
		+	*http://lists.wikimedia.org/pipermail/wikitech-l/2007-February/029707.html

P2P at 12:17, 5 January 2007

2007-01-05T12:17:50Z

←Older revision		Revision as of 12:17, 5 January 2007
Line 3:		Line 3:
	A (totally) distributed approach to Wikipedia and related projects might solve that problem (and create a few others). This projectpage intents to organize efforts to create such an approach.		A (totally) distributed approach to Wikipedia and related projects might solve that problem (and create a few others). This projectpage intents to organize efforts to create such an approach.

-	*[[software]]	+	*[[/software]]

	===The idea: reclaim the World Wide Web for starters===		===The idea: reclaim the World Wide Web for starters===

P2P at 12:17, 5 January 2007

2007-01-05T12:17:39Z

←Older revision		Revision as of 12:17, 5 January 2007
Line 2:		Line 2:

	A (totally) distributed approach to Wikipedia and related projects might solve that problem (and create a few others). This projectpage intents to organize efforts to create such an approach.		A (totally) distributed approach to Wikipedia and related projects might solve that problem (and create a few others). This projectpage intents to organize efforts to create such an approach.
		+
		+	*[[software]]

	===The idea: reclaim the World Wide Web for starters===		===The idea: reclaim the World Wide Web for starters===

Anthony: /* Participants */

2007-01-03T01:54:45Z

Participants

←Older revision		Revision as of 01:54, 3 January 2007
Line 28:		Line 28:
	===Participants===		===Participants===
	(feel free to add your name, and a link to your homepage)<br>		(feel free to add your name, and a link to your homepage)<br>
-	[[Wikipedia:nl:gebruiker:dedalus\|Dedalus]] = [[User:Dedalus\|Dedalus]] 14:44, 29 December 2006 (EST)	+	*[[Wikipedia:nl:gebruiker:dedalus\|Dedalus]] = [[User:Dedalus\|Dedalus]] 14:44, 29 December 2006 (EST)
-	[[User:Anthony\|Anthony]] 06:33, 31 December 2006 (EST)	+	*[[User:Anthony\|Anthony]] 06:33, 31 December 2006 (EST)

Anthony: /* My idea detailed - Anthony */

2006-12-31T11:36:04Z

My idea detailed - Anthony

←Older revision		Revision as of 11:36, 31 December 2006
Line 22:		Line 22:
	* Anonymity - We don't really want mirrors to be able to track users. Fortunately this one has already been solved. Anonymity-conscious users can access Wikipedia through the Tor network. Tor hidden services can be set up to make this less draining on the Tor system (as hidden services don't require open exit nodes). Servers can run the hidden service, the open wiki, or both.		* Anonymity - We don't really want mirrors to be able to track users. Fortunately this one has already been solved. Anonymity-conscious users can access Wikipedia through the Tor network. Tor hidden services can be set up to make this less draining on the Tor system (as hidden services don't require open exit nodes). Servers can run the hidden service, the open wiki, or both.

-	Initial implementation: I'm thinking a vmware player virtual machine running linux. The advantage is speed of design. Almost all the software to do this is already out there, the problem becomes one of configuring a system. The significant disadvantage is that it relies on proprietary freeware, but this would only be for a reference implementation. The protocol would work with a reimplemented client/server which doesn't rely on vmware, and work could begin on that once the virtual machine was working. Eventually no one would have to use the initial implementation - just look at all the different implementations of bittorrent for instance.	+	Initial implementation: I'm thinking a vmware player virtual machine running linux (as the guest). The advantage is speed of design. Almost all the software to do this is already out there, the problem becomes one of configuring a system. The significant disadvantage is that it relies on proprietary freeware, but this would only be for a reference implementation. The protocol would work with a reimplemented client/server which doesn't rely on vmware, and work could begin on that once the virtual machine was working. Eventually no one would have to use the initial implementation - just look at all the different implementations of bittorrent for instance.

	This is a rather quick dump of what I've been thinking about on and off over the course of years. Please, ask me questions and lets get a more detailed design. Or maybe you just wanted to take things in a totally different direction? I haven't yet seen TiddlyWiki. Maybe they've already solved the problems and they're the way to go...		This is a rather quick dump of what I've been thinking about on and off over the course of years. Please, ask me questions and lets get a more detailed design. Or maybe you just wanted to take things in a totally different direction? I haven't yet seen TiddlyWiki. Maybe they've already solved the problems and they're the way to go...

Anthony at 11:33, 31 December 2006

2006-12-31T11:33:50Z

←Older revision		Revision as of 11:33, 31 December 2006
Line 10:		Line 10:

	And I found a place for the Tiddly that can be edited online (at least, by me): http://distributedwikipediaproject.tiddlyspot.com/		And I found a place for the Tiddly that can be edited online (at least, by me): http://distributedwikipediaproject.tiddlyspot.com/
		+
		+	===My idea detailed - Anthony===
		+	Basically my thoughts were to have a sort of mirror-in-a-box. A Wikipedia mirror which could be set up (on at least Windows and Linux for starters) with a few clicks. There are lots of problems with that simplified approach, though, which I think can all be fixed.
		+
		+	* Hard drive space - I think a reasonable minimum for a participant in the distributed system is to dedicate 1 gig of drive space. That's somewhat high, but it's a good enough number for starters. But 1 gig of drive space won't hold the text of the English Wikipedia, let alone all of the projects with images. So we'd have to allow partial mirrors, where each participant takes a particular chunk. This isn't too much of a problem, but there are a lot of different solutions. I currently favor using some sort of hashing mechanism. Thus each mirror only has to distribute the range of hash keys which it is handling.
		+
		+	* Authentication - with a standard Wikipedia mirror, the host is free to change anything. This is in some ways a good thing, but there should at least be a way to designate some sort of "official" version of a file. The way I see doing this is with digital signatures. At the least Wikipedia would have a public/private keypair and could sign articles for its users. In a more advanced version each user could have a public/private keypair and Wikipedia's signature would only be needed upon account creation. The issue with this is I'm not sure it can be easily done in standard java/javascript (without resorting to signed applets which can basically do anything). Maybe I'm wrong there, but if not there would need to be a special client to handle this. That's OK though, people could still test out the system without downloading the client, they just wouldn't be sure of the authentication. As for the client, a simple proxy-type program would work which checked the signatures.
		+
		+	* Bandwidth - Mirrors rely on the main Wikipedia to get their content. This doesn't save much if any money for Wikipedia. The solution to this is pretty obvious. The mirrors will get their information from other mirrors. With the support of the Wikimedia Foundation the main Wikipedia site could be deprecated to where it only handles signatures. Even without their support certain client/servers could be set up to use the IRC channel to monitor changes and then download them as they come.
		+
		+	* Anonymity - We don't really want mirrors to be able to track users. Fortunately this one has already been solved. Anonymity-conscious users can access Wikipedia through the Tor network. Tor hidden services can be set up to make this less draining on the Tor system (as hidden services don't require open exit nodes). Servers can run the hidden service, the open wiki, or both.
		+
		+	Initial implementation: I'm thinking a vmware player virtual machine running linux. The advantage is speed of design. Almost all the software to do this is already out there, the problem becomes one of configuring a system. The significant disadvantage is that it relies on proprietary freeware, but this would only be for a reference implementation. The protocol would work with a reimplemented client/server which doesn't rely on vmware, and work could begin on that once the virtual machine was working. Eventually no one would have to use the initial implementation - just look at all the different implementations of bittorrent for instance.
		+
		+	This is a rather quick dump of what I've been thinking about on and off over the course of years. Please, ask me questions and lets get a more detailed design. Or maybe you just wanted to take things in a totally different direction? I haven't yet seen TiddlyWiki. Maybe they've already solved the problems and they're the way to go...

	===Participants===		===Participants===
	(feel free to add your name, and a link to your homepage)<br>		(feel free to add your name, and a link to your homepage)<br>
	[[Wikipedia:nl:gebruiker:dedalus\|Dedalus]] = [[User:Dedalus\|Dedalus]] 14:44, 29 December 2006 (EST)		[[Wikipedia:nl:gebruiker:dedalus\|Dedalus]] = [[User:Dedalus\|Dedalus]] 14:44, 29 December 2006 (EST)
		+	[[User:Anthony\|Anthony]] 06:33, 31 December 2006 (EST)