Changing your URL structure does not update remote servers

Submitted by march on Thu, 04/21/2011 - 10:22

Issue ID:	3155
Issue Category:	bug
Component:	ostatus
Priority:	critical
Status:	will not fix
Assigned:	evan
Version:	0.9
Keywords:	federation ostatus

there is something wrong with the federation of notices. to track it down @bavatar sent three testnotices:

http://diekershoff.homeunix.net/statusnet/notice/685
http://diekershoff.homeunix.net/statusnet/notice/683
http://diekershoff.homeunix.net/statusnet/notice/680

only the @replies did get federated to @march and @ubuntuusers each.
all others [for example @habi and @direkteaktion] did get all three.

Attachment	Size
bavatar.png	65.46 KB
direkteaktion.png	101.32 KB
habi.png	67.07 KB
march.png	74.9 KB
ubuntuusers.png	81.83 KB

Updates

#1

Submitted by bavatar on Wed, 04/27/2011 - 06:21.

I monitored this thing a little bit, only symptoms though.

From the 17 identica accounts following my account 10 receive my notices and 7 don't. Both of the not-identica accounts from StatusNet receive my notices (maybe low number statistics here?).

If I include them in @-replies the notice arrives. Federated group postings works.

My instance is running StatusNet 0.9.7fix1 on a Debian Squeeze server. It's a new installation after the MySQL database got corrupted and the StatusNet tables could not be recovered. But it's using the old path and account name.

#2

Submitted by march on Sun, 05/01/2011 - 09:15.

additionally this effects the threading of discussions!

bavatar's notice http://diekershoff.homeunix.net/statusnet/notice/8971 does get federated to status.davidhaberthuer.ch but *not* to identi.ca. compare:

http://diekershoff.homeunix.net/statusnet/conversation/7704#notice-8971
and http://identi.ca/conversation/69979165#notice-72336415
and http://status.davidhaberthuer.ch/conversation/35#notice-48

also habi@identi.ca's notice http://identi.ca/notice/72332543 does *not* get federated to diekershoff.homeunix.net but to status.davidhaberthuer.ch. compare:

http://diekershoff.homeunix.net/statusnet/conversation/7704
and http://identi.ca/conversation/69979165#notice-72332543
and http://status.davidhaberthuer.ch/conversation/35#notice-42

#3

Submitted by bavatar on Mon, 05/02/2011 - 00:51.

Regarding the last point: I'm currently not subscribed to @habi@identi.ca to avoid username lookup problems when I just address @habi in a new conversation not replying to a notice he send. This dent was never able to reach me.

#4

Submitted by David Haberthür on Tue, 05/03/2011 - 09:20.

I did a squeaky-clean fresh install of my federated instance [1] sometimes around the time of this bug/problem. Just to keep in mind that there might be some things related to this.

[1] and lost two weeks of notices, since the restore part of the backup didn't work...

#5

Submitted by David Haberthür on Thu, 05/05/2011 - 05:18.

I'm not sure, but think i found another case.

My notice ( http://status.davidhaberthuer.ch/notice/324 ) from conversation http://identi.ca/conversation/70286421 doesn't show up in http://evan.status.net/replies.

I'm not sure because I don't know if my notice should only show up in Evans replies if he's subscribed to me, or if it should only show up in http://evan.status.net/all (which only goes back 11 hours, not the "needed" 20 hours to see my notice)

#6

Submitted by David Haberthür on Wed, 05/11/2011 - 02:53.

Notices from @march@identi.ca from yesterday (10. Mai 2011) are not showing up in http://status.davidhaberthuer.ch/all even though we're both subscribed to each other.

Notices which don't arrive:
- http://identi.ca/notice/73128252
- http://identi.ca/notice/73120500
- http://identi.ca/notice/73120589

#7

Submitted by David Haberthür on Thu, 05/12/2011 - 14:28.

A new example:

My conversation with glynmoody does show up on their respective conversation pages: http://status.davidhaberthuer.ch/conversation/579 and http://identi.ca/conversation/70785698 but his reply never showed up in http://status.davidhaberthuer.ch/replies and I never got an email notification of his reply

#8

Submitted by march on Fri, 05/20/2011 - 07:21.

next one:

http://status.davidhaberthuer.ch/conversation/972#notice-1122 did not get delivered to http://identi.ca/march/replies.

and it is not in http://identi.ca/conversation/71470155#notice-73875875

#9

Submitted by bavatar on Mon, 06/13/2011 - 16:34.

I did a little number count today with reproduce able results. From my 31 followers from identi.ca 16 don't get my postings, 15 do. All 4 of my followers not from identi.ca or the StatusNet-cloud get my dents.

Those identicats who get my dents have subscribed to all times during the lifetime of the server, as have those who don't get the notices. It looks as there is no correlation but I'll look into that aspect later.

#10

Submitted by Charles on Tue, 06/14/2011 - 23:04.

I'm having the same issue with my site: http://parlementum.net which recently migrated from a sn cloud hosted instance to my own. Currently I have lost the ability to see posts from 4 people I was subscribed to. A different 3 people can't see my dents even when I use their name. I can't currently subscribe to remote groups, I can see posts to groups I am subscribed to.

#11

Submitted by Jordan Conway on Mon, 06/20/2011 - 11:27.

I suspect that it might be a caching issue, the status.net servers cache heavily and if you change paths or have a bad config initially the wrong url/ostatus endpoint may be cached. I'll try to get it some more attention.

#12

Submitted by Evan Prodromou on Mon, 06/20/2011 - 12:44.

Title:

some notices do not get federated.

» Changing your URL structure does not update remote servers

The problem is that you keep moving your site around, which messes up our PuSH code. Here are the URIs I have for your account, along with the subscriber count for each:

+------------------------------------------------------------+----------+
| uri | count(*) |
+------------------------------------------------------------+----------+
| http://diekershoff.homeunix.net/argh/index.php/user/1 | 1 |
| http://diekershoff.homeunix.net/sn2/index.php/user/1 | 3 |
| http://diekershoff.homeunix.net/statusnet/index.php/user/1 | 75 |
| http://diekershoff.homeunix.net/statusnet/user/1 | 21 |
| http://sn.diekershoff.homeunix.net/user/1 | 5 |
+------------------------------------------------------------+----------+

It would be nice if you could move your site around, change the URLs, and everything would keep working, but that's not how OStatus works right now. It's very dependent on the URLs you use.

My main suggestion here is _don't change your URLs so much_. I think there may be some magic we could do to make the process of switching these things around easier, but right now it's kind of a pain.

#13

Submitted by bavatar on Mon, 06/20/2011 - 13:09.

It's not that I do these moves intentionally. Maybe StatusNet needs a way to figure out the healthiness of a profile or to "update" a connection.

Anyway I don't see how any of these not valid addresses could be added to the contacts that are currently following me and not getting my dents, as they are subscribed to the correct profile and show up in my subscriber list.

#14

Submitted by Charles on Tue, 06/28/2011 - 14:07.

the issue for me was moving from single user cloud hosted to my own hosted multiuser, thus I went from:
http://parlementum.net

http://parlementum.net/encyclomundi

Will this sort itself out over time?
Anything I can do to speed it up or ask for a 1 time recache

or is my best bet to set up a fresh install on a different domain with different user name, ie:

http://encyclomundi.org/cer ?

#15

Submitted by Jean Baptiste Favre on Fri, 07/15/2011 - 09:41.

Hello,
Just made the mistake to change URL scheme for my instance, enabling FancyURL and SingleUser mode.
My profile changed from http://status.jbfavre.org/index.php/jbfavre to http://status.jbfavre.org/

20 of my subscribers were updated, the others (45 exactly) weren't.
My subscriptions were OK, at least at the beginning. After a while, I began to see many salmon singature failure preventing messages to be delivered. In fact, messages were correctly received on my server but never delivered locally.
Finally lost any incoming message. I assume my profile was not completly updated in remote DB (mostly on identi.ca).

I tried to run /script/updateprofile.php without any great success.
As far as I've seen for now, I finally fixed all my subscriptions runnning /plugins/OStatus/scripts/update-profile.php for each of my subscriptions. That is, grab all subscriptions in DB with SQL and run the script against each URL.

Will see what happen next.

Finally, I figure aht one thing could make sense to avoid such problems when changing URL scheme. With OStatus, only 2 parts are really important: nickname and domain.
Other things like profile URL can be dynamically discovered.
This way, we coud have a better abstraction between "Who I am" and "How you can contact me".
"How I am" should be nickname@domain.tld while "How you can contact me" should be the URL or, better, nickname@domain.tld + webfinger.

Hope it can help